-- Logs begin at Tue 2022-07-19 19:49:03 UTC, end at Tue 2022-07-19 21:17:52 UTC. -- Jul 19 20:39:47.605442 dv-cinder-799871-37-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 20:39:47.613000 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 20:39:47.616903 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 20:39:47 2022] *** Jul 19 20:39:47.616903 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 20:39:47.616903 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 20:39:47.616903 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: nodename: dv-cinder-799871-37-iscsi Jul 19 20:39:47.616903 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: machine: x86_64 Jul 19 20:39:47.616903 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: clock source: unix Jul 19 20:39:47.616903 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: pcre jit disabled Jul 19 20:39:47.616903 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: detected number of CPU cores: 4 Jul 19 20:39:47.616903 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: current working directory: / Jul 19 20:39:47.616903 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: detected binary path: /usr/bin/uwsgi-core Jul 19 20:39:47.616903 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: your processes number limit is 47680 Jul 19 20:39:47.616903 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: your memory page size is 4096 bytes Jul 19 20:39:47.617677 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: detected max file descriptor number: 2048 Jul 19 20:39:47.617677 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: lock engine: pthread robust mutexes Jul 19 20:39:47.617677 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: thunder lock: enabled Jul 19 20:39:47.617677 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 20:39:47.617677 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 20:39:47.661923 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: Python main interpreter initialized at 0x555f0651d9c0 Jul 19 20:39:47.661923 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: python threads support enabled Jul 19 20:39:47.661923 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: your server socket listen backlog is limited to 100 connections Jul 19 20:39:47.661923 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: your mercy for graceful operations on workers is 90 seconds Jul 19 20:39:47.662286 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 20:39:47.662286 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: *** Operational MODE: preforking *** Jul 19 20:39:47.662534 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: *** uWSGI is running in multiple interpreter mode *** Jul 19 20:39:47.662534 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: spawned uWSGI master process (pid: 115331) Jul 19 20:39:47.662744 dv-cinder-799871-37-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 19 20:39:47.664317 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: spawned uWSGI worker 1 (pid: 115332, cores: 1) Jul 19 20:39:47.664317 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: spawned uWSGI worker 2 (pid: 115333, cores: 1) Jul 19 20:39:47.664494 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 20:39:48.378123 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 20:39:48.416222 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 20:39:49.641065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:39:49.641065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: from cryptography.utils import int_from_bytes Jul 19 20:39:49.641810 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:39:49.641810 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: from cryptography.utils import int_from_bytes Jul 19 20:39:49.661008 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:39:49.661008 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: from cryptography.utils import int_from_bytes Jul 19 20:39:49.661770 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:39:49.661770 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: from cryptography.utils import int_from_bytes Jul 19 20:39:52.162894 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 20:39:52.164340 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 20:39:52.164751 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 20:39:52.164851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 20:39:52.164931 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 20:39:52.165007 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 20:39:52.165083 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 20:39:52.165083 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 20:39:52.165217 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 20:39:52.165217 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 20:39:52.165336 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.165588 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.165702 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.165886 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.165993 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.166205 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.166349 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.166539 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.166663 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.166844 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.166941 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.167165 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.167262 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.167482 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.167570 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.167797 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.167894 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.168059 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.168164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.168367 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.168454 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.168678 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.168764 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-37-iscsi {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.168993 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.169090 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-37-iscsi {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.169296 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.169411 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.169634 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.169733 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.169944 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.170034 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.170261 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.170363 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.170563 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.170650 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.170882 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.171021 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.171196 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.171377 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.171702 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.171883 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.172022 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.172136 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.172398 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.172530 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.172660 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.172789 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.172911 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.173024 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.173244 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.173414 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.173562 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.173686 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.173925 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.174108 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.174236 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.174385 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.174650 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.174769 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.174927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.175083 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-37-iscsi {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.175203 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-37-iscsi {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.175348 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.175474 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.175619 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.175751 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.175900 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.176017 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.176233 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.176424 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.176595 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.176753 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.176883 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.177024 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.177166 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.177340 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.177540 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.177693 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.177820 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.177975 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.178114 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.178292 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.178431 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.178652 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.178782 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.178977 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.179148 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.179299 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.179460 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.179620 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.179773 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.179919 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.180071 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.180201 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.180327 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.180452 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.180575 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.180713 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.180853 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.180979 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.181143 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.181285 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.181678 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.181678 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.181929 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.182052 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.182178 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.182308 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.182432 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.182432 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.182696 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.182840 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.182976 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.182976 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.183230 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.183365 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.183486 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.183607 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.183732 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.183868 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.184002 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.184136 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.184278 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.184412 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.184583 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.184745 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.184873 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.184999 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.185187 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.185329 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.185524 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.185673 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.185815 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.185965 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.186102 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.186243 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.186393 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.186532 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.186699 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.186839 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.187020 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.187154 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.187325 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.187458 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.187642 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.187782 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.187971 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.188104 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.188271 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.188400 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.188577 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.188734 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.188878 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.189020 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.189200 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.189347 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.189533 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.189688 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.189815 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.189936 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.190127 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.190261 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.190427 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.190565 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.190729 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.190906 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.191048 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.191171 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.191328 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.191466 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.191590 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.191725 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.191859 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.192026 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.192161 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.192312 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.192476 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.192643 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.192799 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.192945 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.193081 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.193204 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.193329 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.193517 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.193646 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.193788 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.193913 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.194035 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.194172 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.194309 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.194491 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.194636 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.194788 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.194940 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.195083 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.195221 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.195361 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.195499 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.195628 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.195764 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.195921 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.196070 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.196216 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.196368 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.196516 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.196647 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.196813 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.196950 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.197115 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.197265 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.197451 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.197584 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.197725 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.197855 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.197997 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.198144 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.198318 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.198466 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.198706 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.198854 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.198984 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.199127 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.199257 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.199396 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.199546 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.199676 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.199818 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.199952 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.200104 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.200365 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.200519 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.200652 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.200788 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.200960 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.201099 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.201239 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.201527 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.201666 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.201789 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.201940 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.202071 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.202225 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.202355 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.202612 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.202756 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.202888 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.203017 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.203158 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.203289 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.203413 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.203535 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.203664 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.203792 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.203930 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.204311 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.204448 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.204593 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.204733 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.204860 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.205001 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.205131 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.205259 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.205416 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.205564 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.205713 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.205873 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.206008 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.206174 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.206312 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.206476 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.206621 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.206780 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.206928 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.207068 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.207223 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.207383 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:39:52.207531 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.207719 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.207866 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.208041 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.208177 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.208373 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.208517 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.208684 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.208832 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.208972 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.209100 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.209285 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.209544 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.209697 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.210291 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.210475 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.210616 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.210787 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.210925 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.211110 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.211250 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.211418 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.211558 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.211726 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.211865 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.212032 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.212172 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.212361 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.212507 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.212649 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.212782 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.212929 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.213063 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.213209 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.213342 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.213615 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.213763 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.213956 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.214096 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.214231 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.214379 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.214513 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.214645 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.214778 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.214914 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.215086 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.215242 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.215390 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.215529 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.215715 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.215880 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.216027 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.216195 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.216343 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.216482 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.216626 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.216764 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.216899 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.217044 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.217189 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.217329 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.217551 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.217710 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.217858 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.217995 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.218139 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.218268 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.218446 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.218588 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.218759 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.218895 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.219064 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.219199 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.219369 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.219522 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.219670 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.219784 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.219997 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.220237 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.220375 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.220602 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.220842 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.220975 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.221207 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.221343 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.221532 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.221767 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.221914 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.222088 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.222220 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.222407 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.222545 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.222698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.222855 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.222995 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.223126 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.223282 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.223427 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.223567 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.223697 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.223886 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.224016 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.224196 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.224327 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.224495 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.224636 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.224794 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.224926 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.225102 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.225248 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.225489 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.226142 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.226270 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.226394 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.226581 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.226726 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.226884 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.227022 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.227193 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.227338 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.227501 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.227643 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.227805 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.227939 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.228123 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.228261 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.228427 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.228568 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.228726 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.228868 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.229035 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.229179 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.229333 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.229567 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.229696 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.229821 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.229947 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.230079 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.230254 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.230396 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.230555 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.230687 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.230862 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.230996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.231165 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.231297 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.231467 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.231602 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.231776 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.231909 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.232080 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.232210 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.232387 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.232522 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.232696 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.232831 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.233003 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.233153 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.233319 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.233484 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.233778 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.233915 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.234088 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.234330 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.234462 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.234668 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.234788 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.234982 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.235170 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.235338 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.235506 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.235661 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.235794 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.235972 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.236216 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.236384 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.236591 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.236720 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.236869 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.237040 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.237168 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.237331 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.237617 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.237745 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.237925 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.238054 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.238207 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.238349 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.238487 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.238639 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.238782 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.238945 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.239074 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.239248 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.239389 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.239553 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.239694 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.239853 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.239981 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.240154 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.240283 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.240457 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.240610 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.240738 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.240872 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.241127 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.241279 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.241454 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.241586 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.241782 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.241917 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.242114 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.242324 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.242469 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.242598 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.242728 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.242855 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.243025 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.243161 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.243335 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.243469 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.243642 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.243791 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.243949 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.244115 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.244275 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.244412 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.244554 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.244705 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.244839 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.244976 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.245150 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.245300 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.245490 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.245648 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.245785 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.245951 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.246095 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.246232 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.246360 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.246495 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.246691 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.246850 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.246997 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.247131 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.247295 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.247444 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.247620 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.247775 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.247931 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.248062 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.248243 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.248386 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.248549 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.248716 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.248850 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.248986 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.249152 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.249288 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.249487 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.249630 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.249764 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.249898 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.250072 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.250220 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.250461 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.250596 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.250729 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.250880 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.251022 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.251168 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.251312 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.251455 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.251587 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.251721 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.251853 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.251985 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.252162 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.252312 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.252474 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.252603 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.252775 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.252926 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.253088 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.253221 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.253446 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.253579 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.253735 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.253892 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.254021 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.254147 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.254328 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.254462 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.254634 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.254792 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.254940 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.255072 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.255210 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.255337 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.255513 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.255658 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.255822 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.255957 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.256127 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.256262 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.256431 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.256570 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.257258 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.257424 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.257589 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.257720 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.257894 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.258027 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.258194 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.258318 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.258491 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.258630 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.258800 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.258950 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.259104 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.259240 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.259407 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.259526 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.259714 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.259852 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.260029 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.260166 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.260334 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.260480 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.260652 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.260788 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.260967 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.261102 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.261264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.261514 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.261643 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.261766 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.261891 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.262032 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.262160 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.262309 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.262493 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.262629 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.262788 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.262925 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.263088 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.263234 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.263403 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.263537 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.263739 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.263878 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.264010 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.264162 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.264330 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.264604 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.264801 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.264941 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.265084 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.265212 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.265340 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.265546 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.265695 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.265825 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.265971 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.266084 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.266214 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.266349 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.266480 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.266627 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.266768 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.266897 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.267037 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.267204 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.267324 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.267513 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.267647 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.267885 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.268024 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.268194 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.268328 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.268476 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.268603 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.268791 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.268928 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.269095 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.269297 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.269496 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.269716 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.269864 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.270041 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.270178 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.270350 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.270494 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.270668 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.270946 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.271085 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.271274 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.271409 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.271584 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.271731 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.271899 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.272036 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.272215 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.272430 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.273087 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.273288 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.273439 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.273647 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.273782 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.273975 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.274125 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.274288 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.274434 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.274579 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.274706 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.274885 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.275018 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.275147 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.275389 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.275524 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.275657 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.275798 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.275936 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.276077 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.276217 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.276357 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.276498 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.276638 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.276774 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.276915 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.277049 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.277178 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.277316 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.277517 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.277648 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.277792 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.277920 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.278086 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.278230 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.278391 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.278531 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.278676 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.278805 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.278975 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.279108 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.279274 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.279420 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.279590 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.279724 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.279894 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.280037 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.280187 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.280337 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.280480 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.280615 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.280746 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.280878 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.281086 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.281238 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.281397 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.281531 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.281729 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.281872 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.282026 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.282180 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.282321 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.282459 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.282609 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.282746 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.282893 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.283048 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.283187 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.283375 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.283519 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.283657 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.283809 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.283947 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.284104 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.284257 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.284398 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.284522 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.284680 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.284804 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.284935 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.285132 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.285282 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.285520 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.285665 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.285802 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.285937 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.286072 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.286208 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.286359 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.286499 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.286634 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.286769 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.286912 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.287052 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.287200 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.287339 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.287493 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.287634 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.287771 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.287939 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.288656 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.288787 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.288957 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.289115 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.289253 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.289416 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.289577 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.289716 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.289857 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.290009 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.290151 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.290301 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.290450 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.290589 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.290731 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.290869 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.291008 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.291155 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.291292 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.291427 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.291592 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.291735 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.291882 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.292030 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.292172 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.292310 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.292447 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.292589 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.292738 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.292887 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.293027 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.293162 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.293332 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.293611 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.293772 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.293911 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.294048 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.294189 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.294331 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.294476 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.294638 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.294786 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.294989 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.295176 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.295331 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.295479 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.295635 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.295771 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.295913 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.296054 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.296195 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.296332 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.296482 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.296622 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.296759 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.296900 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.297042 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.297190 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.297343 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.297510 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.297635 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.297769 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.297926 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.298079 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.298237 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.298376 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.298518 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.298654 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.298792 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.298941 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.299081 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.299215 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.299215 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.299483 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.299624 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.299782 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.299922 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.300061 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.300197 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.300334 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.300485 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.300623 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.300751 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.300962 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.301097 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.301273 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.301580 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.301720 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.301928 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.302075 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.302215 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.302525 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.302687 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.302813 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.302999 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.303142 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.303419 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.303780 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.304578 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.305057 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.305429 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.305722 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.306039 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.306272 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.306418 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.306623 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.306774 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.306947 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.307087 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.307271 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.307425 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.307565 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.307701 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.307880 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.308032 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.308195 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.308333 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.308487 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.308636 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.308774 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.308923 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.309074 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.309212 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.309348 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.309535 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.309688 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.309839 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.309978 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.310123 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.310263 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.310400 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.310547 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.310708 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.310847 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.310986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.311127 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.311263 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.311440 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.311598 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.311735 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.311873 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.312049 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.312193 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.312357 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.312520 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.312672 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.312813 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.312963 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.313101 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.313250 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.313454 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.313596 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.313750 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.313999 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.314146 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.314146 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.314419 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.314556 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.314705 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.314845 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.314983 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.315134 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.315270 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.315412 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.315537 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.315726 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.315876 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.316028 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.316167 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.316317 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.316456 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.316624 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.316792 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.316939 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.317077 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.317219 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.317399 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.317557 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.317711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.317863 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.318002 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.318139 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.318282 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.318511 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.318681 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.318821 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.318961 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.319101 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.319278 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.319451 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.319607 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.319745 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.319881 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.320028 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.320167 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.320341 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.320573 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.320722 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.320942 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.321074 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.321459 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.321632 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.321774 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.321915 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.322062 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.322201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.322348 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.322502 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.322637 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.322786 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.322920 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.323050 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.323289 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.323447 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.323598 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.323735 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.323871 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.324064 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.324224 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.324375 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.324525 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.324660 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.324798 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.324935 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.325089 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.325262 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.325443 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.325656 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.325803 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.325935 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.326077 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.326211 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.326391 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.326546 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.326716 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.326873 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.327024 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.327165 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.327318 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.327457 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.327635 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.327792 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.327982 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.328128 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.328265 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.328387 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.328594 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.328741 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.328893 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.329296 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.329476 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.329619 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.329758 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.329900 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.330118 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.330273 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.330424 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.330566 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.330702 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.330853 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.331003 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.331155 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.331296 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.331436 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.331576 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.331725 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.331867 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.332018 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.332155 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.332333 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.332492 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.332644 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.332792 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.332971 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.333101 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.333353 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.333670 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.333670 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.334013 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.334195 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.334377 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.334548 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.334721 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.334923 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.335199 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.335515 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.335820 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.335976 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.336120 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.336256 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.336427 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.336569 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.336729 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.336870 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.337057 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.337213 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.337387 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.337525 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.337699 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.337840 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.337995 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.338142 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.338318 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.338474 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.338611 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.338748 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.338933 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.339088 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.339241 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.339382 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.339547 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.339710 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.339860 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.340012 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.340151 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.340286 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.340451 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.340607 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.340749 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.340872 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.341039 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.341169 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.341343 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.341529 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.341687 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.341840 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.341990 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.342138 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.342303 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.342436 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.342587 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.342736 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.342876 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.343021 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.343159 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.343304 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.343463 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.343610 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.343748 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.343928 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.344073 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.344223 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.344357 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.344519 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.344661 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.344826 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.344967 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.345160 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.345297 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.345484 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.345690 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.345873 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.346015 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.346171 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.346312 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.346456 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.346592 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.346737 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.346873 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.347021 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.347169 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.347309 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.347456 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.347601 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.347748 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.347884 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.348018 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.348150 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.348281 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.348418 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.348562 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.348711 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.348859 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.349006 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.349146 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.349286 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.349540 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.349678 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.349818 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.349951 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.350084 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.350216 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.350364 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.351035 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.351185 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.351333 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.351471 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.351617 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.351930 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.352077 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.352224 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.352363 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.352544 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.352795 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.352932 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.353076 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.353217 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.353390 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.353529 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.353688 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.353829 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.353965 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.354099 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.354235 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.354372 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.354522 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.354662 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.354820 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.354960 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.355101 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.355311 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.355458 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.355600 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.355800 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.355944 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.356160 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.356320 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.356460 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.356595 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.356766 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.356916 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.357075 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.357224 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.357410 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.357546 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.357772 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.357914 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.358087 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.358222 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.358388 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.358527 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.358698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.358851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.359010 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.359148 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.359285 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.359409 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.359594 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.359847 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.359990 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.360128 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.360267 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.360414 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.360551 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.360704 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.360836 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.360992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.361132 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.361281 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.361520 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.361678 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.361811 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.361949 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.362087 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.362235 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.362396 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.362536 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.362676 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.362812 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.362965 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.363101 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.363251 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.363381 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.363522 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.363660 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.363857 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.364034 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.364193 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.364334 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.364471 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.364670 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.364816 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.364972 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.365119 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.365301 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.365512 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.365643 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.365788 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.365979 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.366730 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.366873 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.367009 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.367148 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.367284 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.367487 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.367675 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.367848 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.368024 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.368201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.368386 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.368545 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.368701 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.368872 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.368872 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.369202 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.369413 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.369588 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.369763 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.369931 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.370114 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.370303 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.370303 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.370625 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.370809 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.370982 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.371160 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.371335 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.371516 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.371696 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.371883 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.372051 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.372223 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.372405 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.372577 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.372753 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.372924 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.373103 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.373271 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.373512 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.373695 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.373869 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.374041 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.374219 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.374389 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.374567 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.374733 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.374894 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.374894 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.375219 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.375386 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.375573 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.375743 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.375922 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.376094 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.376272 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.376447 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.376635 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.376808 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.376971 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.378007 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.378168 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.378303 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.378303 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.378560 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.378707 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.378840 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.378992 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.379123 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.379253 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.379393 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.379537 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.379670 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.379825 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.379967 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.380120 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.380253 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.380388 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.380536 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.380674 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.380814 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.380948 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.381097 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.381242 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.381412 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.381544 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.381717 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.381852 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.381984 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.382134 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.382280 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.382407 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.382541 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.382671 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.382803 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.382944 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.383085 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.383223 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.383356 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.383356 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.383609 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.383750 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.383915 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.384065 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.384208 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.384377 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.384537 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.384708 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.384872 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.385034 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.385188 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.385342 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.385597 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.385770 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.385770 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.386017 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.386152 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.386297 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.386433 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.386581 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.386716 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.386849 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.386985 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.387117 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.387324 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.387497 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.387692 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.387834 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.387987 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.388135 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.388292 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.388436 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.388581 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.388727 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.388872 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.389035 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.389202 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.389344 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.389520 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.389661 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.389661 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.389919 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.390172 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.390172 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.390435 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.390570 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.390706 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.390868 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.391019 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.391160 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.391299 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.391442 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.391730 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.391877 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.392035 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.392187 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.392334 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.392489 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.392647 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.392795 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.392953 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.393111 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.393260 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.393430 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.393574 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.393709 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.393849 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.393981 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.394114 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.394257 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.394391 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.394536 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.394673 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.394820 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.394952 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.395097 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.395232 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.395366 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.395498 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.395630 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.395774 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.395908 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.396049 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.396183 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.396183 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.396431 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.396431 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.396699 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.396836 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.396972 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.397113 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.397255 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.397668 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.397840 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.397977 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.398129 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.398269 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.398412 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.398567 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.398721 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.398866 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.399009 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.399150 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.399311 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.399454 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.399597 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.399749 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.399890 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.399890 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.400170 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.400309 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.400450 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.400450 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.400702 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.400846 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.401000 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.401139 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.401278 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.401439 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.401598 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.401757 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.401901 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.402131 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.402395 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.402541 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.402681 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.402839 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.402980 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.403117 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.403255 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.403391 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.403525 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.403681 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.403681 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.403932 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.404071 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.404071 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.404344 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.404708 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.404859 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.405001 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.405001 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.405254 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.405438 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.405578 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.405717 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.405864 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.406005 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.406141 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.406297 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.406449 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.406604 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.406758 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.406897 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.407030 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.407180 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.407316 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.407454 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.407662 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.407848 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.408053 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.408199 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.408339 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.408474 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.408623 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.408773 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.408923 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.409060 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.409199 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.409335 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.409571 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.409707 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.409853 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.409993 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.410141 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.410292 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.410428 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.410566 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.410716 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.410858 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.410996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.411131 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.411269 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.411419 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.411558 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.411695 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.411831 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.411964 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.412118 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.412118 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.412385 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.412522 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.412657 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.412793 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.413599 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.413599 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.413874 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.414037 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.414171 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.414302 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.414437 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.414590 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.414731 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.414870 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.415010 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.415146 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.415298 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.415449 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.415587 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.415723 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.415863 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.416001 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.416155 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.416289 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.416421 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.416561 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.416699 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.416845 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.416995 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.417192 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.417336 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.417499 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.417639 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.417952 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.418096 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.418248 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.418401 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.418542 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.418682 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.418839 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.418979 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.419129 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.419328 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.419482 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.419633 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.419785 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.419927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.420066 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.420206 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.420343 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.420488 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.420630 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.420769 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.420906 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.421044 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.421044 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.421296 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.421296 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.421555 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.421555 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.421790 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.421921 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.422077 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.422215 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.422352 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.422481 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.422613 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.422763 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.422904 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.422904 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 20:39:52.423144 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.423144 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.423144 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.423144 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.423144 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.423734 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.423869 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.424195 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.424671 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.425243 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.425651 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.426083 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.426529 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.426897 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.427247 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.427559 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.427865 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:39:52.428109 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 20:39:52.484624 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO dbcounter [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Registered counter for database nova_api Jul 19 20:39:52.490710 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO dbcounter [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] Registered counter for database nova_api Jul 19 20:39:52.598381 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_db.sqlalchemy.engines [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:39:52.603838 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG oslo_db.sqlalchemy.engines [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:39:52.605451 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writer thread running {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:39:52.610334 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG dbcounter [-] [115332] Writer thread running {{(pid=115332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:39:52.661416 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.context [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d9380775-e089-461a-bf53-b88b5dcfb5f1(cell1) {{(pid=115333) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 20:39:52.666087 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:52.667266 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.context [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d9380775-e089-461a-bf53-b88b5dcfb5f1(cell1) {{(pid=115332) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 20:39:52.667621 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:52.668411 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:52.670597 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:52.671409 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG oslo_concurrency.lockutils [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:52.672599 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO dbcounter [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Registered counter for database nova_cell0 Jul 19 20:39:52.672998 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG oslo_concurrency.lockutils [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:52.673824 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG oslo_concurrency.lockutils [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:39:52.675980 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG oslo_concurrency.lockutils [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115332) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:39:52.676641 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO dbcounter [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Registered counter for database nova_cell1 Jul 19 20:39:52.678026 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO dbcounter [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] Registered counter for database nova_cell0 Jul 19 20:39:52.682266 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO dbcounter [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] Registered counter for database nova_cell1 Jul 19 20:39:52.685460 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_db.sqlalchemy.engines [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:39:52.687147 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_db.sqlalchemy.engines [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:39:52.689731 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG oslo_db.sqlalchemy.engines [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:39:52.691872 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writer thread running {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:39:52.693380 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG oslo_db.sqlalchemy.engines [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:39:52.695072 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writer thread running {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:39:52.695903 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG dbcounter [-] [115332] Writer thread running {{(pid=115332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:39:52.841500 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG dbcounter [-] [115332] Writer thread running {{(pid=115332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:39:52.845444 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO dbcounter [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Registered counter for database nova_cell0 Jul 19 20:39:52.851689 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO dbcounter [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] Registered counter for database nova_cell0 Jul 19 20:39:52.855021 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_db.sqlalchemy.engines [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:39:52.859784 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writer thread running {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:39:52.863622 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG oslo_db.sqlalchemy.engines [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:39:52.868218 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG dbcounter [-] [115332] Writer thread running {{(pid=115332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:39:53.198042 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: WARNING keystonemiddleware.auth_token [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:39:53.198917 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: WARNING keystonemiddleware.auth_token [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:39:53.205705 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: WARNING keystonemiddleware.auth_token [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:39:53.207871 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: WARNING keystonemiddleware.auth_token [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:39:53.553088 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: WARNING keystonemiddleware.auth_token [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:39:53.554691 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: WARNING keystonemiddleware.auth_token [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:39:53.559703 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: WARNING keystonemiddleware.auth_token [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:39:53.561059 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: WARNING keystonemiddleware.auth_token [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:39:53.565412 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555f0651d9c0 pid: 115332 (default app) Jul 19 20:39:53.566602 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555f0651d9c0 pid: 115333 (default app) Jul 19 20:39:53.567509 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:39:53.568692 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-8141f442-e1fa-4022-a56f-b97c6bc1fae7 None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001767 Jul 19 20:39:53.569097 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Tue Jul 19 20:39:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:16.773494 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:16.774710 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Jul 19 20:41:16.775562 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:16.787427 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG dbcounter [-] [115332] Writing DB stats nova_api:SELECT=3 {{(pid=115332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:16.788701 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG dbcounter [-] [115332] Writing DB stats nova_cell0:SELECT=3 {{(pid=115332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:16.789561 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG dbcounter [-] [115332] Writing DB stats nova_cell1:SELECT=3 {{(pid=115332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:16.790268 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG dbcounter [-] [115332] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:17.696553 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-ac232fa5-7d0c-4dcb-8385-1dafbeb89507 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:17.735324 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-ac232fa5-7d0c-4dcb-8385-1dafbeb89507 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.953905 Jul 19 20:41:17.736247 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 2/3] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jul 19 20:41:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:20.238241 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:20.239731 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-fa9e4d70-8cfc-4c96-b3b1-f7e97e0857d2 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Jul 19 20:41:20.241829 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 2/4] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:41:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:20.799866 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-402598f3-715b-47d5-aff7-4a9aaefb4747 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "ram": 256, "vcpus": 1}} {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:20.820309 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:41:20.820309 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: warnings.warn(msg) Jul 19 20:41:20.851664 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-402598f3-715b-47d5-aff7-4a9aaefb4747 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.603605 Jul 19 20:41:20.859464 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 3/5] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 19 20:41:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:41:20.866180 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writing DB stats nova_api:SELECT=3 {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:20.867020 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writing DB stats nova_cell1:SELECT=3 {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:20.868013 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writing DB stats nova_cell0:SELECT=3 {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:20.869025 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:21.104606 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-9e407dba-2b97-4094-84d9-eb759c401988 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:21.107883 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:41:21.107883 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: warnings.warn(msg) Jul 19 20:41:21.182928 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-9e407dba-2b97-4094-84d9-eb759c401988 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.322157 Jul 19 20:41:21.183832 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 3/6] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jul 19 20:41:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:23.571091 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-402598f3-715b-47d5-aff7-4a9aaefb4747 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:23.572401 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-402598f3-715b-47d5-aff7-4a9aaefb4747 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 Jul 19 20:41:23.572971 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 4/7] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:41:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:24.286217 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-27c63d02-067c-41d5-88ba-3e08c32378c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:24.305020 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:41:24.305020 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: warnings.warn(msg) Jul 19 20:41:24.330054 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-27c63d02-067c-41d5-88ba-3e08c32378c1 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.750276 Jul 19 20:41:24.331282 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 4/8] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 19 20:41:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:41:24.344352 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-c81bfd98-a15a-4d06-95cc-e1ba9fc61278 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:24.345921 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:41:24.345921 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: warnings.warn(msg) Jul 19 20:41:24.389884 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-c81bfd98-a15a-4d06-95cc-e1ba9fc61278 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049210 Jul 19 20:41:24.390944 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 5/9] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jul 19 20:41:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:41:26.776987 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-27c63d02-067c-41d5-88ba-3e08c32378c1 admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:26.778336 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-27c63d02-067c-41d5-88ba-3e08c32378c1 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002386 Jul 19 20:41:26.778819 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:41:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:27.190622 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-863f5f8d-94cb-4cae-bc5e-68930cd24c3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:27.216247 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-863f5f8d-94cb-4cae-bc5e-68930cd24c3d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431368 Jul 19 20:41:27.226953 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 6/11] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 19 20:41:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:41:27.236171 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-38972f2e-d937-4b9d-bbd2-e70da5618bec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:27.266086 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-38972f2e-d937-4b9d-bbd2-e70da5618bec admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034412 Jul 19 20:41:27.266684 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 6/12] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jul 19 20:41:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:29.674006 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-863f5f8d-94cb-4cae-bc5e-68930cd24c3d admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:29.675376 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-863f5f8d-94cb-4cae-bc5e-68930cd24c3d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Jul 19 20:41:29.675913 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 7/13] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:41:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:30.389206 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-c2161884-7e9a-4172-9282-24bea9813916 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:30.423257 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-c2161884-7e9a-4172-9282-24bea9813916 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.737697 Jul 19 20:41:30.429903 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 7/14] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 19 20:41:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:41:30.443006 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-04bc1349-3ccf-4f34-a22e-d92323303460 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:30.477486 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-04bc1349-3ccf-4f34-a22e-d92323303460 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040688 Jul 19 20:41:30.478370 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 8/15] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jul 19 20:41:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:33.233990 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-c2161884-7e9a-4172-9282-24bea9813916 admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:33.235160 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-c2161884-7e9a-4172-9282-24bea9813916 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001813 Jul 19 20:41:33.235760 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 8/16] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:41:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:41:33.914484 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-9f2cdc72-26eb-4306-ad44-5c12770593f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "disk": 20, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4"}} {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:33.947044 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-9f2cdc72-26eb-4306-ad44-5c12770593f3 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.703641 Jul 19 20:41:33.961203 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 9/17] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 19 20:41:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 20:41:33.970440 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-14d13300-6305-43c7-9cb6-0b8b0bdec6cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:34.016770 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-14d13300-6305-43c7-9cb6-0b8b0bdec6cb admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052360 Jul 19 20:41:34.029344 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 9/18] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jul 19 20:41:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:36.855871 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-9f2cdc72-26eb-4306-ad44-5c12770593f3 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:36.857285 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-9f2cdc72-26eb-4306-ad44-5c12770593f3 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Jul 19 20:41:36.857939 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 10/19] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:41:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:37.555199 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-cb753b99-3de9-496f-b7b8-864ff4e25003 admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:37.586934 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-cb753b99-3de9-496f-b7b8-864ff4e25003 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.719134 Jul 19 20:41:37.587502 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 10/20] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jul 19 20:41:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:41:40.574837 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-9f2cdc72-26eb-4306-ad44-5c12770593f3 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:40.576688 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-9f2cdc72-26eb-4306-ad44-5c12770593f3 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002583 Jul 19 20:41:40.577572 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 11/21] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:41:40 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:41:41.211035 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-828bc15b-de50-4061-8e03-3c9b2c815d6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "ram": 512, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "disk": 1, "rxtx_factor": 1.0}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:41.237374 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-828bc15b-de50-4061-8e03-3c9b2c815d6a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.651753 Jul 19 20:41:41.238012 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 11/22] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 19 20:41:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:41:41.259044 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-8485644a-0268-461f-8d41-fe01b83e3aa4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:41.299016 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-8485644a-0268-461f-8d41-fe01b83e3aa4 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045290 Jul 19 20:41:41.299016 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 12/23] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jul 19 20:41:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:41:43.906111 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-828bc15b-de50-4061-8e03-3c9b2c815d6a admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:43.907110 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-828bc15b-de50-4061-8e03-3c9b2c815d6a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 19 20:41:43.907530 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 12/24] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:41:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:44.359529 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-8cf3393b-ae2d-43a6-83c2-5d53cf071a84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:44.382440 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-8cf3393b-ae2d-43a6-83c2-5d53cf071a84 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.467842 Jul 19 20:41:44.382892 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 13/25] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 19 20:41:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:41:44.396635 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-006cf537-31eb-43ed-ac68-7807c7243353 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:44.423271 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-006cf537-31eb-43ed-ac68-7807c7243353 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030587 Jul 19 20:41:44.423865 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 13/26] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jul 19 20:41:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:46.826039 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-8cf3393b-ae2d-43a6-83c2-5d53cf071a84 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:46.827747 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-8cf3393b-ae2d-43a6-83c2-5d53cf071a84 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002190 Jul 19 20:41:46.828419 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 14/27] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:41:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:47.304703 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-6ad01756-7bea-4c65-b9e1-ab0aa7708a3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:47.325213 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-6ad01756-7bea-4c65-b9e1-ab0aa7708a3a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.489865 Jul 19 20:41:47.325796 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 14/28] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 19 20:41:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:41:47.338263 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-df97381d-a481-4fbd-a9c5-64efa9915d9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:47.341777 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG dbcounter [-] [115332] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=115332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:47.370873 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-df97381d-a481-4fbd-a9c5-64efa9915d9c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033310 Jul 19 20:41:47.370873 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 15/29] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jul 19 20:41:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:41:49.840794 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-6ad01756-7bea-4c65-b9e1-ab0aa7708a3a admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:49.841877 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-6ad01756-7bea-4c65-b9e1-ab0aa7708a3a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 19 20:41:49.842432 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 15/30] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:41:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:50.425832 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-b4d5badb-0b79-4207-943a-ed5692cafba6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:50.447990 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-b4d5badb-0b79-4207-943a-ed5692cafba6 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.599035 Jul 19 20:41:50.448942 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 16/31] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 19 20:41:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:41:50.476613 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-df182635-1ed4-41d8-b6db-1b9c886eb1d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:50.502621 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-df182635-1ed4-41d8-b6db-1b9c886eb1d4 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040928 Jul 19 20:41:50.505923 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 16/32] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jul 19 20:41:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:41:52.951084 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-b4d5badb-0b79-4207-943a-ed5692cafba6 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:41:52.952028 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-b4d5badb-0b79-4207-943a-ed5692cafba6 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 19 20:41:52.953705 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 17/33] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:41:53.651166 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-1ffff253-f537-4fd0-873f-aa62b60b64b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "ram": 16384, "name": "m1.xlarge"}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:53.662219 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:53.714196 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-1ffff253-f537-4fd0-873f-aa62b60b64b0 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.754728 Jul 19 20:41:53.715240 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 17/34] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 19 20:41:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:41:53.730901 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-0ea04458-33e3-4d67-b67c-2c8a3bed709b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:41:53.769874 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-0ea04458-33e3-4d67-b67c-2c8a3bed709b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045563 Jul 19 20:41:53.785394 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 18/35] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jul 19 20:41:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:42:12.377453 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-1ffff253-f537-4fd0-873f-aa62b60b64b0 admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:12.379133 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-1ffff253-f537-4fd0-873f-aa62b60b64b0 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001856 Jul 19 20:42:12.380088 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 18/36] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:42:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:12.392559 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG dbcounter [-] [115332] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=115332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:12.801996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-aedab3dd-3ac6-4af8-b24a-c1d6c797a81a admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:12.819870 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-aedab3dd-3ac6-4af8-b24a-c1d6c797a81a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.432264 Jul 19 20:42:12.820428 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 19/37] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jul 19 20:42:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:42:13.978296 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-1ffff253-f537-4fd0-873f-aa62b60b64b0 admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:13.979293 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-1ffff253-f537-4fd0-873f-aa62b60b64b0 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 19 20:42:13.979855 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 19/38] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 19 20:42:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:14.560181 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-f69b4a9d-744c-4bdb-aafe-23944c94dca9 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:14.565889 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.wsgi [None req-f69b4a9d-744c-4bdb-aafe-23944c94dca9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-f69b4a9d-744c-4bdb-aafe-23944c94dca9 admin admin] Request method failure captured: Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Accept: application/json Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Accept-Encoding: gzip, deflate Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Connection: keep-alive Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Content-Length: 0 Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Host: 10.222.0.70 Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Openstack-Api-Version: compute 2.90 Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Openstack-System-Scope: None Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: User-Agent: python-novaclient Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Auth-Token: gAAAAABi1xclpUb5-cWtP2nYPdQEBVaZ-FegXScWmSIjclj5JWkBoJZC7x8GsLYh5d4kmbB2p8v8H4xU4GpGy3qwt9gjsTg_V10zVdbF3r_-skZzHQB2cmpkx9ClyQUhzOLjT1AZmUZyazfDBzK9MSOkMRu0dUtMgDmNxpHeJnrQsVHV1gObliU Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Domain-Id: None Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Domain-Name: None Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Identity-Status: Confirmed Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Is-Admin-Project: True Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Project-Domain-Id: default Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Project-Domain-Name: Default Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Project-Id: a9ddf9c6d32c459d8f135c30485e0f10 Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Project-Name: admin Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Role: member,reader,admin Jul 19 20:42:14.569291 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Roles: member,reader,admin Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a9ddf9c6d32c459d8f135c30485e0f10", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Tenant: admin Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Tenant-Id: a9ddf9c6d32c459d8f135c30485e0f10 Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Tenant-Name: admin Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User: admin Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User-Domain-Id: default Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User-Domain-Name: Default Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User-Id: 629381bc156b476a94122bdd0a64b60d Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User-Name: admin Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: method: > Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: exception: Flavor 42 could not be found. Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: action_args: {'id': '42'} Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:42:14.570986 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:14.571927 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:14.573164 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-f69b4a9d-744c-4bdb-aafe-23944c94dca9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:42:14.574592 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-f69b4a9d-744c-4bdb-aafe-23944c94dca9 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.455574 Jul 19 20:42:14.574592 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 20/39] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jul 19 20:42:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 19 20:42:14.584822 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-ffd46b40-62bd-4e95-8c84-c68a8be9099c admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:14.606674 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-ffd46b40-62bd-4e95-8c84-c68a8be9099c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026601 Jul 19 20:42:14.607257 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 20/40] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jul 19 20:42:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:42:14.617814 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-4ad0fbf9-7631-4c73-b726-a0639f65727a admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:14.639824 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-4ad0fbf9-7631-4c73-b726-a0639f65727a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026257 Jul 19 20:42:14.640394 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 21/41] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jul 19 20:42:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:42:14.650167 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-2b98d307-7b97-4a85-aeb8-2abdb7021d34 admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:14.655948 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.wsgi [None req-2b98d307-7b97-4a85-aeb8-2abdb7021d34 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-2b98d307-7b97-4a85-aeb8-2abdb7021d34 admin admin] Request method failure captured: Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Accept: application/json Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Accept-Encoding: gzip, deflate Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Connection: keep-alive Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Content-Length: 0 Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Host: 10.222.0.70 Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Openstack-Api-Version: compute 2.90 Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Openstack-System-Scope: None Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: User-Agent: python-novaclient Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Auth-Token: gAAAAABi1xclpUb5-cWtP2nYPdQEBVaZ-FegXScWmSIjclj5JWkBoJZC7x8GsLYh5d4kmbB2p8v8H4xU4GpGy3qwt9gjsTg_V10zVdbF3r_-skZzHQB2cmpkx9ClyQUhzOLjT1AZmUZyazfDBzK9MSOkMRu0dUtMgDmNxpHeJnrQsVHV1gObliU Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Domain-Id: None Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Domain-Name: None Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Identity-Status: Confirmed Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Is-Admin-Project: True Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Project-Domain-Id: default Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Project-Domain-Name: Default Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Project-Id: a9ddf9c6d32c459d8f135c30485e0f10 Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Project-Name: admin Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Role: member,reader,admin Jul 19 20:42:14.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Roles: member,reader,admin Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a9ddf9c6d32c459d8f135c30485e0f10", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Tenant: admin Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Tenant-Id: a9ddf9c6d32c459d8f135c30485e0f10 Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Tenant-Name: admin Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User: admin Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User-Domain-Id: default Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User-Domain-Name: Default Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User-Id: 629381bc156b476a94122bdd0a64b60d Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User-Name: admin Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: method: > Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: exception: Flavor 42 could not be found. Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: action_args: {'id': '42'} Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:42:14.660711 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:14.661651 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:14.662927 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-2b98d307-7b97-4a85-aeb8-2abdb7021d34 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:42:14.664112 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-2b98d307-7b97-4a85-aeb8-2abdb7021d34 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014092 Jul 19 20:42:14.664112 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 21/42] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jul 19 20:42:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 19 20:42:15.647519 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-4ad0fbf9-7631-4c73-b726-a0639f65727a admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:15.648546 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-4ad0fbf9-7631-4c73-b726-a0639f65727a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 19 20:42:15.648936 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 22/43] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 19 20:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:16.208867 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-dd2abbad-b948-47a9-add8-b5877e3dd368 admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:16.214687 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.wsgi [None req-dd2abbad-b948-47a9-add8-b5877e3dd368 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-dd2abbad-b948-47a9-add8-b5877e3dd368 admin admin] Request method failure captured: Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Accept: application/json Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Accept-Encoding: gzip, deflate Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Connection: keep-alive Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Content-Length: 0 Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Host: 10.222.0.70 Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Openstack-Api-Version: compute 2.90 Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Openstack-System-Scope: None Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: User-Agent: python-novaclient Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Auth-Token: gAAAAABi1xcncx0ejkYA8P4GyLBA3_eSWCSxvduOb0aNQBElTtbKPQNMUM4j89i6VW1MxhuWyrTupOEr6yC5TwYfo8txIU6_zeBelPiKfnAEiAqjVUYFBuU-eu90MUHO18iJ-FGoJ0KOY5CkvjWhjlbFPqsAsUSA0kf14GU8hET-93cXxQf4wGc Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Domain-Id: None Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Domain-Name: None Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Identity-Status: Confirmed Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Is-Admin-Project: True Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Project-Domain-Id: default Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Project-Domain-Name: Default Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Project-Id: a9ddf9c6d32c459d8f135c30485e0f10 Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Project-Name: admin Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Role: member,reader,admin Jul 19 20:42:16.216201 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Roles: member,reader,admin Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a9ddf9c6d32c459d8f135c30485e0f10", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Tenant: admin Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Tenant-Id: a9ddf9c6d32c459d8f135c30485e0f10 Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Tenant-Name: admin Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User: admin Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User-Domain-Id: default Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User-Domain-Name: Default Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User-Id: 629381bc156b476a94122bdd0a64b60d Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User-Name: admin Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: method: > Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: exception: Flavor 84 could not be found. Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: action_args: {'id': '84'} Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:42:16.217765 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:16.218677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:16.220065 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-dd2abbad-b948-47a9-add8-b5877e3dd368 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:42:16.221272 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-dd2abbad-b948-47a9-add8-b5877e3dd368 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.427420 Jul 19 20:42:16.221272 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 22/44] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jul 19 20:42:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:42:16.227343 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-d27ebcec-3f37-4cd1-9342-1f7256b9c293 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:16.241523 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-d27ebcec-3f37-4cd1-9342-1f7256b9c293 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017729 Jul 19 20:42:16.242085 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 23/45] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jul 19 20:42:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:42:16.251667 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-73572211-e788-4fe8-ab24-d1d9aa59780a admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:16.266121 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-73572211-e788-4fe8-ab24-d1d9aa59780a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017963 Jul 19 20:42:16.266664 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 23/46] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jul 19 20:42:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:42:16.276251 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-3c3355ca-dd13-449e-9639-499d3d7a3364 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:16.281844 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.wsgi [None req-3c3355ca-dd13-449e-9639-499d3d7a3364 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-3c3355ca-dd13-449e-9639-499d3d7a3364 admin admin] Request method failure captured: Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Accept: application/json Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Accept-Encoding: gzip, deflate Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Connection: keep-alive Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Content-Length: 0 Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Host: 10.222.0.70 Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Openstack-Api-Version: compute 2.90 Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Openstack-System-Scope: None Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: User-Agent: python-novaclient Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Auth-Token: gAAAAABi1xcncx0ejkYA8P4GyLBA3_eSWCSxvduOb0aNQBElTtbKPQNMUM4j89i6VW1MxhuWyrTupOEr6yC5TwYfo8txIU6_zeBelPiKfnAEiAqjVUYFBuU-eu90MUHO18iJ-FGoJ0KOY5CkvjWhjlbFPqsAsUSA0kf14GU8hET-93cXxQf4wGc Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Domain-Id: None Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Domain-Name: None Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Identity-Status: Confirmed Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Is-Admin-Project: True Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Project-Domain-Id: default Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Project-Domain-Name: Default Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Project-Id: a9ddf9c6d32c459d8f135c30485e0f10 Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Project-Name: admin Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Role: member,reader,admin Jul 19 20:42:16.283364 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Roles: member,reader,admin Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a9ddf9c6d32c459d8f135c30485e0f10", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Tenant: admin Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Tenant-Id: a9ddf9c6d32c459d8f135c30485e0f10 Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Tenant-Name: admin Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User: admin Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User-Domain-Id: default Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User-Domain-Name: Default Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User-Id: 629381bc156b476a94122bdd0a64b60d Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User-Name: admin Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: method: > Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: exception: Flavor 84 could not be found. Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: action_args: {'id': '84'} Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:42:16.284851 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:16.286442 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:16.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-3c3355ca-dd13-449e-9639-499d3d7a3364 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:42:16.289296 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-3c3355ca-dd13-449e-9639-499d3d7a3364 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012074 Jul 19 20:42:16.289296 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 24/47] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jul 19 20:42:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:42:17.289591 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-73572211-e788-4fe8-ab24-d1d9aa59780a admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:17.290670 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-73572211-e788-4fe8-ab24-d1d9aa59780a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Jul 19 20:42:17.291101 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 24/48] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 19 20:42:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:17.833191 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-b73bd15d-a2f5-49d5-b10d-4b433925d839 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:17.838970 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.wsgi [None req-b73bd15d-a2f5-49d5-b10d-4b433925d839 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-b73bd15d-a2f5-49d5-b10d-4b433925d839 admin admin] Request method failure captured: Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Accept: application/json Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Accept-Encoding: gzip, deflate Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Connection: keep-alive Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Content-Length: 0 Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Host: 10.222.0.70 Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Openstack-Api-Version: compute 2.90 Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Openstack-System-Scope: None Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: User-Agent: python-novaclient Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Auth-Token: gAAAAABi1xcpOq_Dj1eOVMJgQJTgNE8pn24nhPvxWv9NguK9dnRV9HddYU8k6WA8t4Z6dge6Vbii9RB1z7_5nIdcasoISz6fVyL-T5I15tAQAXX3qNNp48-3oYybn4qaKBaQFIFqXvmu4dpzJzgmxD11gzjanVvQwzpICq8RMqgqaayVwPkE2Q0 Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Domain-Id: None Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Domain-Name: None Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Identity-Status: Confirmed Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Is-Admin-Project: True Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Project-Domain-Id: default Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Project-Domain-Name: Default Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Project-Id: a9ddf9c6d32c459d8f135c30485e0f10 Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Project-Name: admin Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Role: member,reader,admin Jul 19 20:42:17.840468 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Roles: member,reader,admin Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a9ddf9c6d32c459d8f135c30485e0f10", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Tenant: admin Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Tenant-Id: a9ddf9c6d32c459d8f135c30485e0f10 Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-Tenant-Name: admin Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User: admin Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User-Domain-Id: default Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User-Domain-Name: Default Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User-Id: 629381bc156b476a94122bdd0a64b60d Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: X-User-Name: admin Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: method: > Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: exception: Flavor 451 could not be found. Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: action_args: {'id': '451'} Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:42:17.842117 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:17.842996 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: ERROR nova.api.openstack.wsgi Jul 19 20:42:17.844264 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-b73bd15d-a2f5-49d5-b10d-4b433925d839 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115332) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:42:17.845762 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-b73bd15d-a2f5-49d5-b10d-4b433925d839 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.413524 Jul 19 20:42:17.845762 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 25/49] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 19 20:42:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:42:17.853042 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-f8cd0507-dca1-4e9c-b3ce-d41939f3aaa7 admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:17.867158 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-f8cd0507-dca1-4e9c-b3ce-d41939f3aaa7 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017650 Jul 19 20:42:17.867654 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 25/50] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jul 19 20:42:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:42:17.877308 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:17.893865 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019970 Jul 19 20:42:17.894448 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 26/51] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jul 19 20:42:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:42:17.904451 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-fa632720-f608-4807-9825-6b454df6ca00 admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:17.909961 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.wsgi [None req-fa632720-f608-4807-9825-6b454df6ca00 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-fa632720-f608-4807-9825-6b454df6ca00 admin admin] Request method failure captured: Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Accept: application/json Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Accept-Encoding: gzip, deflate Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Connection: keep-alive Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Content-Length: 0 Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Host: 10.222.0.70 Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Openstack-Api-Version: compute 2.90 Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Openstack-System-Scope: None Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: User-Agent: python-novaclient Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Auth-Token: gAAAAABi1xcpOq_Dj1eOVMJgQJTgNE8pn24nhPvxWv9NguK9dnRV9HddYU8k6WA8t4Z6dge6Vbii9RB1z7_5nIdcasoISz6fVyL-T5I15tAQAXX3qNNp48-3oYybn4qaKBaQFIFqXvmu4dpzJzgmxD11gzjanVvQwzpICq8RMqgqaayVwPkE2Q0 Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Domain-Id: None Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Domain-Name: None Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Identity-Status: Confirmed Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Is-Admin-Project: True Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Project-Domain-Id: default Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Project-Domain-Name: Default Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Project-Id: a9ddf9c6d32c459d8f135c30485e0f10 Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Project-Name: admin Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Role: member,reader,admin Jul 19 20:42:17.912123 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Roles: member,reader,admin Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9ddf9c6d32c459d8f135c30485e0f10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a9ddf9c6d32c459d8f135c30485e0f10", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Tenant: admin Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Tenant-Id: a9ddf9c6d32c459d8f135c30485e0f10 Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-Tenant-Name: admin Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User: admin Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User-Domain-Id: default Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User-Domain-Name: Default Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User-Id: 629381bc156b476a94122bdd0a64b60d Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: X-User-Name: admin Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: method: > Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: exception: Flavor 451 could not be found. Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: action_args: {'id': '451'} Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:42:17.913698 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:17.914535 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: ERROR nova.api.openstack.wsgi Jul 19 20:42:17.915583 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-fa632720-f608-4807-9825-6b454df6ca00 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115333) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:42:17.916585 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-fa632720-f608-4807-9825-6b454df6ca00 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013038 Jul 19 20:42:17.916585 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 26/52] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 19 20:42:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:42:18.913212 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:18.914269 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 19 20:42:18.915153 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 27/53] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 19 20:42:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:19.468852 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-58038355-adc9-4f7a-82ea-fe305f9a9b1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:19.490335 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-58038355-adc9-4f7a-82ea-fe305f9a9b1a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.433698 Jul 19 20:42:19.490893 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 27/54] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jul 19 20:42:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:42:20.489610 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:20.490629 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002134 Jul 19 20:42:20.491030 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 28/55] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 19 20:42:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:42:21.083770 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-af1e94f2-02b4-4f42-b7cc-41e86e8e1cd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:21.102490 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-af1e94f2-02b4-4f42-b7cc-41e86e8e1cd8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.462047 Jul 19 20:42:21.103051 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 28/56] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jul 19 20:42:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:42:22.148830 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:22.149874 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 19 20:42:22.150284 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 29/57] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 19 20:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:22.752217 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-bb74dc8b-d92b-42ed-9db1-69eb2e8b5dd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:22.771923 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-bb74dc8b-d92b-42ed-9db1-69eb2e8b5dd8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.463691 Jul 19 20:42:22.772467 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 29/58] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jul 19 20:42:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:42:23.775000 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:23.776584 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Jul 19 20:42:23.776749 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 30/59] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 19 20:42:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:24.332734 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-ddfebe54-526f-4756-8f64-573fe0de339a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:42:24.350755 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-ddfebe54-526f-4756-8f64-573fe0de339a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.436399 Jul 19 20:42:24.351309 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 30/60] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jul 19 20:42:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:42:25.408049 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:25.409436 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002169 Jul 19 20:42:25.410003 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 31/61] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 19 20:42:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:42:26.037879 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-b303c161-aedb-45e5-8dab-d9749332672c admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:42:26.057697 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-b303c161-aedb-45e5-8dab-d9749332672c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.441501 Jul 19 20:42:26.058523 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 31/62] 10.222.0.70 () {60 vars in 1202 bytes} [Tue Jul 19 20:42:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:43:23.718273 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:23.718273 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-84cba2fd-101d-4eb4-9e75-e7a9f8b9fa0e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002116 Jul 19 20:43:23.718273 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 32/63] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 19 20:43:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:43:23.727036 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:24.183054 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-2f1f77d4-d5f1-4585-a189-46e80d6763aa admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:24.207645 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-2f1f77d4-d5f1-4585-a189-46e80d6763aa admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.485124 Jul 19 20:43:24.208649 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 32/64] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jul 19 20:43:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:43:24.242393 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-2d3f56c4-1736-4a1f-b6e3-dcedd331c2b6 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:24.248034 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG dbcounter [-] [115332] Writing DB stats nova_api:SELECT=14 {{(pid=115332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:24.257336 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-2d3f56c4-1736-4a1f-b6e3-dcedd331c2b6 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.021268 Jul 19 20:43:24.258160 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 33/65] 10.222.0.70 () {60 vars in 1282 bytes} [Tue Jul 19 20:43:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:24.274817 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-c416d94a-2f92-4704-8f3c-9d475ccf8168 admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:24.283576 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-c416d94a-2f92-4704-8f3c-9d475ccf8168 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012953 Jul 19 20:43:24.284396 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 33/66] 10.222.0.70 () {60 vars in 1285 bytes} [Tue Jul 19 20:43:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:43:24.306243 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-c0a6bb17-a4e4-48d2-be95-2e449c7f2f35 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:24.320163 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-c0a6bb17-a4e4-48d2-be95-2e449c7f2f35 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020917 Jul 19 20:43:24.321210 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 34/67] 10.222.0.70 () {60 vars in 1285 bytes} [Tue Jul 19 20:43:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:43:24.335193 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-5e2d89f8-f11d-4374-9e15-479a14990b05 admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:43:24.344737 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-5e2d89f8-f11d-4374-9e15-479a14990b05 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014014 Jul 19 20:43:24.345319 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 34/68] 10.222.0.70 () {60 vars in 1282 bytes} [Tue Jul 19 20:43:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:46:54.622901 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-c0a6bb17-a4e4-48d2-be95-2e449c7f2f35 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:54.623964 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-c0a6bb17-a4e4-48d2-be95-2e449c7f2f35 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 19 20:46:54.624309 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 35/69] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 19 20:46:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:54.773256 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writing DB stats nova_api:SELECT=6 {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:54.947051 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-2f3af12b-d0aa-47f5-bac6-1107456f335d admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:54.948385 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:46:54.948385 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: warnings.warn(msg) Jul 19 20:46:54.950027 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-2f3af12b-d0aa-47f5-bac6-1107456f335d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:54.950557 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-2f3af12b-d0aa-47f5-bac6-1107456f335d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:54.951498 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-2f3af12b-d0aa-47f5-bac6-1107456f335d admin admin] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:54.952343 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-2f3af12b-d0aa-47f5-bac6-1107456f335d admin admin] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:54.994387 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-2f3af12b-d0aa-47f5-bac6-1107456f335d admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.222934 Jul 19 20:46:54.994976 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 35/70] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 19 20:46:54 2022] GET /compute/v2.1/os-services => generated 794 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:46:55.850844 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-c0a6bb17-a4e4-48d2-be95-2e449c7f2f35 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:55.851887 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-c0a6bb17-a4e4-48d2-be95-2e449c7f2f35 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 19 20:46:55.852284 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 36/71] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 19 20:46:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:46:56.070106 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-b99a96ad-705c-45b2-a4ce-768fc4accac5 admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:56.071351 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:46:56.071351 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: warnings.warn(msg) Jul 19 20:46:56.072562 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-b99a96ad-705c-45b2-a4ce-768fc4accac5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:56.073007 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-b99a96ad-705c-45b2-a4ce-768fc4accac5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:56.073813 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-b99a96ad-705c-45b2-a4ce-768fc4accac5 admin admin] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:46:56.074482 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-b99a96ad-705c-45b2-a4ce-768fc4accac5 admin admin] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:46:56.095110 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-b99a96ad-705c-45b2-a4ce-768fc4accac5 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.082776 Jul 19 20:46:56.095690 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 36/72] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 19 20:46:56 2022] GET /compute/v2.1/os-services => generated 794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:47:07.362613 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-c0a6bb17-a4e4-48d2-be95-2e449c7f2f35 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:07.363621 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-c0a6bb17-a4e4-48d2-be95-2e449c7f2f35 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 19 20:47:07.364006 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 37/73] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 19 20:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:07.512605 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writing DB stats nova_cell0:SELECT=4 {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:07.513333 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writing DB stats nova_cell1:SELECT=4 {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:07.513979 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG dbcounter [-] [115333] Writing DB stats nova_api:SELECT=8 {{(pid=115333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:07.562823 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-1ff000dc-0669-4f03-ade2-fd0f7e1ffaaa admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:07.564559 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:47:07.564559 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: warnings.warn(msg) Jul 19 20:47:07.565785 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-1ff000dc-0669-4f03-ade2-fd0f7e1ffaaa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:07.566231 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-1ff000dc-0669-4f03-ade2-fd0f7e1ffaaa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:07.567020 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-1ff000dc-0669-4f03-ade2-fd0f7e1ffaaa admin admin] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:07.567467 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-1ff000dc-0669-4f03-ade2-fd0f7e1ffaaa admin admin] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:07.593230 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-1ff000dc-0669-4f03-ade2-fd0f7e1ffaaa admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.084921 Jul 19 20:47:07.593745 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 37/74] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 19 20:47:07 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:47:08.561025 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: DEBUG nova.api.openstack.wsgi [None req-c0a6bb17-a4e4-48d2-be95-2e449c7f2f35 admin admin] Calling method '>' {{(pid=115332) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:08.562073 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: INFO nova.api.openstack.requestlog [None req-c0a6bb17-a4e4-48d2-be95-2e449c7f2f35 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 19 20:47:08.562474 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: [pid: 115332|app: 0|req: 38/75] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 19 20:47:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:08.754677 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG nova.api.openstack.wsgi [None req-0ffba551-2900-4a9a-9d7b-fe45eb0fe28a admin admin] Calling method '>' {{(pid=115333) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:08.755926 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:47:08.755926 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: warnings.warn(msg) Jul 19 20:47:08.757146 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-0ffba551-2900-4a9a-9d7b-fe45eb0fe28a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:08.757620 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-0ffba551-2900-4a9a-9d7b-fe45eb0fe28a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:08.758429 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-0ffba551-2900-4a9a-9d7b-fe45eb0fe28a admin admin] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:47:08.758853 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: DEBUG oslo_concurrency.lockutils [None req-0ffba551-2900-4a9a-9d7b-fe45eb0fe28a admin admin] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115333) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:47:08.780541 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: INFO nova.api.openstack.requestlog [None req-0ffba551-2900-4a9a-9d7b-fe45eb0fe28a admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078500 Jul 19 20:47:08.781111 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: [pid: 115333|app: 0|req: 38/76] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 19 20:47:08 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:48:05.896632 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: Tue Jul 19 20:48:05 2022 - graceful shutdown triggered... Jul 19 20:48:05.896735 dv-cinder-799871-37-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 19 20:48:05.897742 dv-cinder-799871-37-iscsi devstack@n-api.service[115332]: Gracefully killing worker 1 (pid: 115332)... Jul 19 20:48:05.898145 dv-cinder-799871-37-iscsi devstack@n-api.service[115333]: Gracefully killing worker 2 (pid: 115333)... Jul 19 20:48:06.897787 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: worker 1 buried after 1 seconds Jul 19 20:48:06.897787 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: worker 2 buried after 1 seconds Jul 19 20:48:06.898464 dv-cinder-799871-37-iscsi devstack@n-api.service[115331]: goodbye to uWSGI. Jul 19 20:48:06.899349 dv-cinder-799871-37-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 19 20:48:06.899909 dv-cinder-799871-37-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 19 20:48:06.902738 dv-cinder-799871-37-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 20:48:06.913208 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 20:48:06.915846 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 20:48:06 2022] *** Jul 19 20:48:06.915846 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 20:48:06.915846 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 20:48:06.915846 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: nodename: dv-cinder-799871-37-iscsi Jul 19 20:48:06.915846 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: machine: x86_64 Jul 19 20:48:06.915846 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: clock source: unix Jul 19 20:48:06.915846 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: pcre jit disabled Jul 19 20:48:06.915846 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: detected number of CPU cores: 4 Jul 19 20:48:06.915846 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: current working directory: / Jul 19 20:48:06.915846 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: detected binary path: /usr/bin/uwsgi-core Jul 19 20:48:06.916573 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: your processes number limit is 47680 Jul 19 20:48:06.916573 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: your memory page size is 4096 bytes Jul 19 20:48:06.916573 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: detected max file descriptor number: 2048 Jul 19 20:48:06.916573 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: lock engine: pthread robust mutexes Jul 19 20:48:06.916573 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: thunder lock: enabled Jul 19 20:48:06.916573 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 20:48:06.916573 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 20:48:06.961827 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: Python main interpreter initialized at 0x559b9118e9c0 Jul 19 20:48:06.961827 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: python threads support enabled Jul 19 20:48:06.961827 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: your server socket listen backlog is limited to 100 connections Jul 19 20:48:06.961827 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: your mercy for graceful operations on workers is 90 seconds Jul 19 20:48:06.962406 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 20:48:06.962406 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: *** Operational MODE: preforking *** Jul 19 20:48:06.962672 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: *** uWSGI is running in multiple interpreter mode *** Jul 19 20:48:06.962672 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: spawned uWSGI master process (pid: 129850) Jul 19 20:48:06.962895 dv-cinder-799871-37-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 19 20:48:06.963437 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: spawned uWSGI worker 1 (pid: 129866, cores: 1) Jul 19 20:48:06.963945 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: spawned uWSGI worker 2 (pid: 129867, cores: 1) Jul 19 20:48:06.964236 dv-cinder-799871-37-iscsi devstack@n-api.service[129850]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 20:48:07.640163 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 20:48:07.648971 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 20:48:08.865597 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:48:08.865597 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: from cryptography.utils import int_from_bytes Jul 19 20:48:08.866273 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:48:08.866273 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: from cryptography.utils import int_from_bytes Jul 19 20:48:08.876212 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:48:08.876212 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: from cryptography.utils import int_from_bytes Jul 19 20:48:08.876721 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:48:08.876721 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: from cryptography.utils import int_from_bytes Jul 19 20:48:11.164627 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 20:48:11.165321 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 20:48:11.165674 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 20:48:11.165784 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 20:48:11.166033 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 20:48:11.166414 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.166739 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.167051 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.167373 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.167700 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.168012 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.168333 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.168652 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.168978 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.169236 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.169599 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.169914 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-37-iscsi {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.170233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.170539 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.170846 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.171162 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.171465 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.171790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.172092 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.172585 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.174076 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.174076 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.174076 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.174388 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.174601 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.175083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.175544 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.175999 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.176478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.176932 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.177491 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-37-iscsi {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.177952 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.178303 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 20:48:11.178754 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 20:48:11.179032 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.179145 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 20:48:11.179447 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 20:48:11.179701 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 20:48:11.179880 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.180084 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.180408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.180728 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.180938 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.181057 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.181376 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.181713 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.181846 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.182025 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.182161 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.182374 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.182710 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.182830 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.183033 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.183137 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.183366 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.183486 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.183686 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.183796 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.184010 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.184111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-37-iscsi {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.184330 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.184428 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.184636 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.184751 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.184947 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.185069 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.185261 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.185392 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.185595 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.185705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.185905 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.186004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.186213 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.186324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.186483 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.186771 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.186868 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.187096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.187210 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.187400 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.187504 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.187711 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.187876 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.188043 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.188199 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.188346 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.189003 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.189166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.189319 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.189527 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.189685 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.189850 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.190004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.190157 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.190318 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.190465 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.190617 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.190773 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.190918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-37-iscsi {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.191109 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.191285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.191458 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.191634 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.191791 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.191948 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.192107 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.192107 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.192442 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.192594 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.192749 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.192906 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.193062 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.193209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.193392 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.193547 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.193722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.193722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.194576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.194576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.194867 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.195023 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.195178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.195354 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.195513 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.195746 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.195916 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.196066 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.196217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.196378 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.196552 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.196699 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.196845 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.196990 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.197141 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.197297 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.197486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.197634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.197790 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.197946 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.198175 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.198331 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.198486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.198651 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.198796 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.198950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.199110 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.199268 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.199422 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.199578 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.199731 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.199879 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.200038 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.200193 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.200338 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.200523 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.200670 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.200831 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.200985 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.201131 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.201276 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.201457 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.201619 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.201781 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.201927 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.202074 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.202226 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.202390 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.202536 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.202693 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.202847 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.202992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.203145 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.203302 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.203447 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.203604 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.203758 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.203902 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.204046 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.205782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.206047 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.206203 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.206362 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.206509 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.206653 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.206803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.206957 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.207111 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.207268 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.207430 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.207584 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.207748 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.207905 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.208070 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.208226 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.208382 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.208537 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.208683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.208826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.208970 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.209114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.209273 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.209463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.209624 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.209779 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.209932 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.210099 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.210255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.210402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.210559 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.210714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.210859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.211021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.211176 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.211322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.211479 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.211637 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.211783 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.211951 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.212106 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.212252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.212466 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.212466 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.212801 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.212957 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.213102 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.213475 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.213644 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.213799 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.213945 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.214104 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.214268 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.214533 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.214687 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.214842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.215680 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.215680 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.216312 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.216472 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.216626 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.216773 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.216927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.217073 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.217218 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.217416 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.217581 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.217740 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.217898 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.218143 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.218296 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.218442 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.218597 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.218752 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.218914 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.219061 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.219215 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.219373 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.219530 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.219676 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.219863 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.220020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.220182 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.220335 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.220490 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.220643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.220797 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.220951 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.221107 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.221262 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.221451 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.221612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.221768 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.221922 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.222079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.222225 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.222371 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.222523 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.222670 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.222824 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.222980 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.223133 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.223278 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.223527 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.223679 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.223841 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.223989 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.224135 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.224287 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.224432 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.224681 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.224844 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.225000 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.225244 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.225591 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.225900 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.225900 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.226503 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.226666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.226813 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.226966 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.227112 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.227258 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.227418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.227573 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.227719 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.227871 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.228024 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.228179 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.228345 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.228507 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.228671 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.228826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:48:11.228972 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.229125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.229271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.229448 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.229602 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.229756 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.230762 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.230927 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.231095 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.231242 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.231467 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.231467 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.231774 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.231929 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.232074 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.232219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.232370 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.232526 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.232680 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.232838 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.232997 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.233144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.233297 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.233516 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.233762 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.233925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.234072 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.234227 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.234373 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.234544 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.234722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.234963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.235113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.235538 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.235960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.236149 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.236325 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.236775 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.236929 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.237084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.237246 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.237430 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.237593 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.237741 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.237895 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.238049 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.238215 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.238363 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.238516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.238663 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.238816 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.238971 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.239126 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.239281 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.239426 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.239579 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.239724 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.239878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.240048 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.240203 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.240350 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.240496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.240648 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.240803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.240962 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.241109 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.241260 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.241439 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.241599 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.241755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.241902 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.242067 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.242168 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.242329 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.242484 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.242645 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.242798 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.242955 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.243100 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.243244 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.243402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.243556 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.243701 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.243967 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.244153 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.244245 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.244340 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.244577 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.244685 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.244774 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.244859 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.244969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.245068 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.245154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.245252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.245368 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.245469 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.245558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.245656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.245744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.245859 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.246163 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.246269 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.246365 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.246466 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.246571 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.246734 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.246991 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.247087 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.247188 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.247283 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.247368 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.247458 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.247543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.247635 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.247729 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.247822 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.247908 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.247991 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.248074 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.248074 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.248247 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.248247 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.248401 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.248484 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.248575 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.248659 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.248827 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.248915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.248998 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.249081 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.249173 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.249272 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.249448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.249551 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.249638 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.249722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.249813 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.249913 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.250009 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.250094 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.250178 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.250261 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.250352 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.250445 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.250530 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.250620 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.250713 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.250798 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.250889 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.251499 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.251592 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.251685 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.251770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.251861 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.251955 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.252049 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.252135 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.252224 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.252318 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.252402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.252494 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.252579 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.252669 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.252761 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.252846 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.252939 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.253033 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.253118 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.253201 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.253284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.253391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.253491 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.253653 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.253740 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.253832 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.253938 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.254085 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.254185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.254279 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.254371 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.254463 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.254548 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.254631 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.254711 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.254783 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.254852 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.254930 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.255002 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.255083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.255163 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.255255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.255339 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.255429 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.255515 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.255651 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.255796 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.255917 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.256017 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.256327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.256433 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.256533 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.256626 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.256712 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.256838 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.256939 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.257045 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.257129 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.257214 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.257297 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.257427 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.257505 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.257588 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.257689 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.257774 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.257859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.257949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.258034 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.258117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.258218 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.258311 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.258396 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.258486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.258579 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.258671 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.258769 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.258855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.258945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.259037 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.259122 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.259214 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.259299 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.259522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.259630 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.259842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.259947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.260152 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.260248 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.260466 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.260567 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.260776 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.260877 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.261083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.261183 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.261406 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.261517 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.261717 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.261819 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.262029 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.262132 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.262337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.262438 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.262642 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.262749 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.262951 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.263045 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.263261 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.263363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.263570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.263676 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.263878 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.263973 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.264188 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.264282 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.264496 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.264609 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.264799 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.264891 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.265102 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.265205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.265435 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.265550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.265750 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.265880 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.266057 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.266257 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.266505 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.266710 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.267386 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.267544 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.267690 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.267835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.267992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.268136 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.268285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.268428 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.268570 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.268749 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.268911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.269064 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.269209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.269350 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.269597 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.269853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.270026 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.270180 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.270344 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.270497 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.270657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.270836 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.271230 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.271401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.271564 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.271724 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.271886 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.272048 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.272210 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.272372 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.272534 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.272695 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.272857 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.273019 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.273181 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.273334 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.273523 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.273689 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.273842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.274005 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.274167 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.274320 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.274472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.274623 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.274783 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.274948 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.275102 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.275260 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.275420 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.275584 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.275746 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.275898 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.276049 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.276209 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.276362 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.276541 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.276649 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.276745 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.276832 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.276954 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.277049 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.277130 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.277211 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.277289 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.277390 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.277520 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.277666 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.277809 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.277905 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.278167 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.278359 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.278471 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.278574 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.278769 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.278874 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.279079 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.279212 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.279380 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.279483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.279685 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.279780 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.280328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.280438 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.280526 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.280619 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.280713 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.280814 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.281120 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.281229 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.281318 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.281601 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.281696 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.281783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.281858 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.281939 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.282127 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.282264 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.282420 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.282604 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.282733 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.282838 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.283043 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.283145 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.283344 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.283444 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.283647 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.283743 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.283948 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.284041 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.284256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.284349 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.284560 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.284657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.284871 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.284978 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.285188 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.285299 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.285560 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.285781 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.285884 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.286157 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.286271 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.286474 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.286581 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.286774 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.286886 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.287075 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.287170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.287377 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.287473 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.287685 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.287783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.287993 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.288088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.288296 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.288391 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.288605 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.288713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.288915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.289017 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.289222 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.289324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.289553 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.289660 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.289855 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.289958 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.290163 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.290259 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.290468 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.290658 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.290765 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.290855 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.291062 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.291170 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.291361 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.291478 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.291662 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.291771 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.291963 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.292075 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.292265 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.292377 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.292566 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.292677 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.292866 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.292976 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.293165 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.293268 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.293498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.293614 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.293800 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.293893 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.294101 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.294197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.294402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.294496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.294705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.294798 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.295004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.295106 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.295301 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.295404 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.295619 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.295722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.295928 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.296023 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.296230 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.296324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.296531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.296645 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.296839 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.297012 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.297160 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.297304 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.297473 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.297574 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.297740 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.297855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.298090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.298201 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.298401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.298509 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.298704 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.298797 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.299011 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.299314 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.299421 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.299617 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.299712 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.299919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.300022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.300227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.300321 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.300562 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.300722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.300816 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.300909 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.301117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.301298 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.301441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.301561 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.301777 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.301918 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.302046 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.302169 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.302364 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.302487 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.302669 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.302793 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.302978 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.303109 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.303280 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.303402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.303582 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.303713 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.303890 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.304015 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.304194 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.304316 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.304510 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.304643 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.304814 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.304938 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.306135 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.306303 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.306404 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.306508 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.306591 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.306850 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.306952 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.307035 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.307115 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.307223 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.307310 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.307394 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.307488 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.307574 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.307666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.307758 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.307843 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.307916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.307986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.308056 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.308141 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.308293 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.308388 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.308603 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.308697 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.308915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.309025 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.309236 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.309330 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.309688 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.310011 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.310313 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.310628 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.310761 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.310951 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.311058 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.311260 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.311433 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.311570 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.311666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.311886 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.312016 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.312194 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.312310 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.312500 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.312603 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.312809 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.312921 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.313116 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.313235 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.313951 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.314070 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.314272 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.314374 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.314581 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.314686 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.314887 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.314997 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.315189 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.315293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.315493 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.315597 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.315800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.315903 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.316102 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.316195 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.316408 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.316503 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.316713 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.316859 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.317029 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.317135 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.317318 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.317433 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.317709 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.317802 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.318024 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.318118 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.318338 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.318444 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.318654 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.318749 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.318960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.319060 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.319269 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.319372 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.319579 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.319682 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.319889 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.320055 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.320194 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.320297 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.320548 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.320650 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.320869 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.320974 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.321181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.321284 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.321537 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.321775 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.321860 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.322094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.322202 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.322397 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.322492 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.322707 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.322802 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.323031 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.323126 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.323339 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.323433 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.323644 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.323748 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.323947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.324042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.324253 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.324356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.324558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.324665 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.324869 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.324967 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.325182 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.325284 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.325542 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.325656 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.325854 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.325950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.326163 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.326292 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.326470 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.326602 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.326802 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.326907 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.327152 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.327304 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.327416 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.327513 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.327696 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.327836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.327999 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.328134 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.328307 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.328442 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.328609 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.328751 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.328919 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.329088 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.329868 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.329973 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.330268 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.330380 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.330584 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.330681 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.330889 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.330985 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.331199 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.331303 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.331512 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.331631 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.331822 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.331916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.332140 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.332276 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.332456 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.332582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.332759 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.332866 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.333155 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.333267 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.333500 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.333625 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.333802 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.333906 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.334112 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.334242 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.334422 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.334518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.334725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.335069 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.335447 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.335617 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.335751 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.335900 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.336038 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.336192 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.336333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.336493 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.336646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.336776 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.336933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.337079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.337228 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.337696 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.337970 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.338279 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.338698 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.339006 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.339317 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.339639 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.339961 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.340541 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.340761 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.340857 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.341145 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.341242 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.341535 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.341664 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.341801 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.341897 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.342260 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.342374 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.342470 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.342565 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.342736 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.342841 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.343077 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.343184 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.343356 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.343497 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.343678 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.343832 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.343988 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.344152 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.344395 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.344504 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.344752 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.344952 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.345080 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.345212 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.345412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.345518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.345739 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.345861 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.346061 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.346162 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.346407 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.346510 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.346668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.346765 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.346977 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.347071 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.347343 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.347478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.347771 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.347885 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.348135 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.348261 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.348348 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.348429 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.348552 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.348671 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.348965 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.349291 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.349457 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.349624 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.350029 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.350124 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.350415 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.350601 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.350728 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.351057 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.351154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.351376 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.351469 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.351694 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.351867 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.352038 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.352224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.352457 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.352656 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.352748 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.352821 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.352908 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.353073 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.353234 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.353321 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.353578 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.353705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.353881 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.353979 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.354183 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.354294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.354518 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.354640 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.354828 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.354920 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.355164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.355379 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.355501 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.355784 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.355886 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.355974 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.356145 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.356251 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.356456 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.356564 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.356770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.356868 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.357094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.357190 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.357432 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.357553 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.357914 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.358015 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.358103 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.358290 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.358402 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.358596 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.358691 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.358918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.359010 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.359209 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.359314 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.359514 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.359610 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.359819 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.359913 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.360122 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.360227 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.360940 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.361042 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.361247 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.361343 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.361578 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.361686 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.361885 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.362183 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.362343 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.362522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.362682 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.362838 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.362989 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.363134 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.363278 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.363427 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.363581 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.363724 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.363872 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.364022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.364172 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.364330 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.364487 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.364629 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.364785 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.364935 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.365080 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.365235 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.365406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.365548 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.365687 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.365837 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.365989 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.366181 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.366322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.366465 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.366608 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.366783 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.366888 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.367100 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.367185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.367418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.367539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.367753 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.367872 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.368146 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.368245 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.368368 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.368458 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.368670 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.368782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.368981 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.369079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.369291 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.369421 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.369628 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.369738 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.369941 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.370038 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.370254 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.370568 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.370661 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.370883 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.371007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.371192 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.371325 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.371501 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.371607 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.371842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.371961 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.372145 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.372240 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.372432 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.372531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.372748 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.372846 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.373056 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.373140 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.373463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.373574 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.373767 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.373872 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.374017 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.374100 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.374342 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.374552 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.374669 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.374874 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.375006 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.375210 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.375380 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.375541 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.375632 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.375914 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.376061 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.376788 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.376899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.377052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.377159 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.377388 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.377478 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.378516 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.378607 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.378691 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.378773 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.378852 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.378935 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.379015 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.379088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.379159 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.379237 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.379512 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.379711 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.379804 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.380087 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.380194 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.380407 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.380504 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.380725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.380949 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.381245 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.381451 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.381588 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.381733 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.382044 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.382366 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.382684 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.382809 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.382889 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.382978 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.383218 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.383323 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.383523 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.383647 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.383834 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.383977 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.384152 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.384298 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.384466 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.384617 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.384772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.384939 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.385106 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.385488 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.385595 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.385717 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.385830 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.386022 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.386148 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.386332 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.386475 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.386636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.386800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.386963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.387120 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.387268 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.387439 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.387574 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.387834 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.387956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.388068 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.388193 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.388452 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.388563 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.388674 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.388783 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.388982 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.389077 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.389287 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.389437 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.389676 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.389865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.390038 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.390196 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.390352 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.390522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.390688 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.390834 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.390983 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.391137 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.391292 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.391443 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.391629 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.391815 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.391964 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.392141 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.392294 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.392448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.392580 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.392726 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.392877 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.393020 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.393176 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.393336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.393592 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.393696 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.393926 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.394020 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.394256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.394367 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.394541 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.394648 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.394863 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.394972 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.395176 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.395453 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.395548 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.395772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.395874 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.396084 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.396180 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.396394 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.396496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.396698 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.396801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.397007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.397104 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.397310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.397443 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.397653 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.397756 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.397962 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.398144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.398326 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.398615 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.398766 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.398929 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.399081 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.399225 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.399368 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.399510 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.399657 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.399808 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.399969 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.400112 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.400253 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.400402 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.400572 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.400727 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.400877 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.401026 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.401175 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.401326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.401593 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.401737 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.401898 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.402046 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.402217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.402358 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.402516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.402674 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.402827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.402970 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.403112 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.403252 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.403422 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.403564 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.403706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.403866 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.404014 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.404156 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.404311 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.404460 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.404600 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.404747 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.404894 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.405047 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.405143 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.405325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.405450 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.405539 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.405622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.405781 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.405781 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.405966 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.406093 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.406301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.406518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.406628 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.406831 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.406926 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.407153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.407277 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.407499 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.407611 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.407812 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.407933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.408133 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.408250 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.408454 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.408551 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.408788 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.408874 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.409053 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.409148 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.409455 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.409557 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.409707 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.409804 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.410017 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.410113 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.410326 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.410431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.410633 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.410729 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.410963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.411066 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.411269 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.411372 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.411577 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.411671 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.411886 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.411994 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.412204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.412298 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.412510 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.412613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.412812 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.412916 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.413115 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.413217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.413453 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.413665 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.413769 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.413866 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.414077 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.414267 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.414433 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.414584 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.414792 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.414953 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.415100 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.415265 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.415265 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.415558 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.415912 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.416095 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.416232 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.416414 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.416547 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.416725 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.416851 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.417037 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.417242 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.417402 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.417585 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.417727 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.417946 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.418089 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.418307 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.418430 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.418553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.418833 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.418940 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.419029 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.419122 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.419209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.419423 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.419530 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.419744 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.419839 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.420052 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.420155 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.420379 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.420507 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.420703 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.420812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.421017 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.421114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.421340 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.421458 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.421667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.421776 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.421972 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.422101 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.422278 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.422490 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.422589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.422738 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.423432 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.423649 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.423765 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.423903 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.424009 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.424219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.424311 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.424531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.424625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.424844 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.424928 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.425155 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.425239 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.425565 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.425690 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.425805 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.425917 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.426098 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.426229 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.426425 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.426556 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.426731 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.426863 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.427055 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.427198 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.427363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.427494 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.427668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.427846 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.427982 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.428125 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.428258 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.428390 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.428553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.428690 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.428847 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.429156 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.429293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.429446 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.429607 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.429769 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.429904 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.430029 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.430152 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.430267 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.430408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.430548 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.430723 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.430857 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.431044 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.431181 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.431355 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.431501 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.431674 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.431821 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.431983 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.432128 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.432303 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.432449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.432609 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.432826 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.432960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.433093 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.433223 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.433421 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.433651 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.433863 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.433998 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.434130 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.434246 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.434369 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.434484 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.434613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.434765 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.434899 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.435078 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.435271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.435397 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.435520 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.435698 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.435829 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 20:48:11.436022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.436327 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.436653 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.436971 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.437293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.437638 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.438313 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.438313 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.439312 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.439485 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.439795 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.440108 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.440419 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.440737 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.441050 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.441384 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.441705 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.442103 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.443016 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.443016 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.443279 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.443393 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.443771 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.444074 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.444388 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.444735 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.445069 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.445419 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.445738 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.446046 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:48:11.446291 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 20:48:11.590956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO dbcounter [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] Registered counter for database nova_api Jul 19 20:48:11.602343 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO dbcounter [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] Registered counter for database nova_api Jul 19 20:48:11.611684 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_db.sqlalchemy.engines [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:48:11.618812 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writer thread running {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:48:11.623445 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_db.sqlalchemy.engines [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:48:11.631064 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writer thread running {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:48:11.676501 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.context [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d9380775-e089-461a-bf53-b88b5dcfb5f1(cell1) {{(pid=129866) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 20:48:11.680569 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:11.682222 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:11.683019 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:11.685004 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:11.687024 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO dbcounter [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] Registered counter for database nova_cell0 Jul 19 20:48:11.688048 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.context [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d9380775-e089-461a-bf53-b88b5dcfb5f1(cell1) {{(pid=129867) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 20:48:11.691707 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO dbcounter [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] Registered counter for database nova_cell1 Jul 19 20:48:11.692689 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:11.694491 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:11.695294 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:48:11.697307 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:48:11.699090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_db.sqlalchemy.engines [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:48:11.699368 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO dbcounter [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] Registered counter for database nova_cell0 Jul 19 20:48:11.701919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_db.sqlalchemy.engines [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:48:11.703533 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO dbcounter [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] Registered counter for database nova_cell1 Jul 19 20:48:11.706786 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writer thread running {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:48:11.711219 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_db.sqlalchemy.engines [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:48:11.712599 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writer thread running {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:48:11.712957 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_db.sqlalchemy.engines [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:48:11.719422 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writer thread running {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:48:11.721240 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writer thread running {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:48:11.861163 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO dbcounter [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] Registered counter for database nova_cell0 Jul 19 20:48:11.865532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO dbcounter [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] Registered counter for database nova_cell0 Jul 19 20:48:11.868105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_db.sqlalchemy.engines [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:48:11.872242 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_db.sqlalchemy.engines [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:48:11.872589 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writer thread running {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:48:11.876856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writer thread running {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:48:12.196643 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: WARNING keystonemiddleware.auth_token [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:48:12.199609 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: WARNING keystonemiddleware.auth_token [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:48:12.204197 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: WARNING keystonemiddleware.auth_token [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:48:12.207055 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: WARNING keystonemiddleware.auth_token [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:48:12.551340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: WARNING keystonemiddleware.auth_token [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:48:12.557449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: WARNING keystonemiddleware.auth_token [None req-d1d09b17-368c-4d17-90f4-f23c22ab2fc8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:48:12.558542 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: WARNING keystonemiddleware.auth_token [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:48:12.563870 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b9118e9c0 pid: 129866 (default app) Jul 19 20:48:12.564797 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: WARNING keystonemiddleware.auth_token [None req-48279bb6-b4cf-4bb3-9929-6b7d5aa8a659 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:48:12.571188 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b9118e9c0 pid: 129867 (default app) Jul 19 20:48:54.538462 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=3 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:54.539204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=3 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:54.539942 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=3 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:54.540679 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=3 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:55.018173 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:55.019000 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:55.019986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:55.020743 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:55.914041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8ff2d96a-a9bf-43ac-ba92-5264954ad472 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Action: 'create', calling method: .version_select at 0x7f2535fe2c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1769107588"}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:56.348616 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2512b56f-cbb2-4754-bbf6-ab552a410e7e tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Action: 'create', calling method: .version_select at 0x7f2535fe1c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-144226230", "metadata": {"Type": "work"}}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:48:57.848595 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8ff2d96a-a9bf-43ac-ba92-5264954ad472 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.317574 Jul 19 20:48:57.849243 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 1/1] 10.222.0.70 () {60 vars in 1154 bytes} [Tue Jul 19 20:48:54 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3320 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 20:48:57.872754 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f0bfabfe-167a-4b8d-b89e-0abe55c84d33 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ea5a60>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:58.008380 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2512b56f-cbb2-4754-bbf6-ab552a410e7e tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.997496 Jul 19 20:48:58.009327 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 1/2] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jul 19 20:48:55 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3000 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 19 20:48:58.024180 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-98ce8ad1-947a-4bbf-8e84-46337447d6aa tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Calling method '.version_select at 0x7f2535eaca60>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:58.139760 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f0bfabfe-167a-4b8d-b89e-0abe55c84d33 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475" status: 200 len: 345 microversion: 2.1 time: 0.279910 Jul 19 20:48:58.140609 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:48:57 2022] GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475 => generated 345 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:58.266564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-98ce8ad1-947a-4bbf-8e84-46337447d6aa tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399" status: 200 len: 352 microversion: 2.1 time: 0.249228 Jul 19 20:48:58.268405 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:48:58 2022] GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 => generated 352 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:48:59.153013 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-176fa568-1ebc-4973-9325-af5d2301a561 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ea5d30>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:59.285169 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-53f9e2ea-b54e-4d59-8934-d0fb4ac0715a tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Calling method '.version_select at 0x7f2535eacc10>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:59.334272 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-176fa568-1ebc-4973-9325-af5d2301a561 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475" status: 200 len: 345 microversion: 2.1 time: 0.182915 Jul 19 20:48:59.334272 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 3/5] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:48:59 2022] GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475 => generated 345 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:59.509830 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-53f9e2ea-b54e-4d59-8934-d0fb4ac0715a tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399" status: 200 len: 352 microversion: 2.1 time: 0.231734 Jul 19 20:48:59.510622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 3/6] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:48:59 2022] GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 => generated 352 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:49:00.353543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7bd045c3-da15-4a94-aea9-32a1ca73ef05 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ec61f0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:00.469613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-7bd045c3-da15-4a94-aea9-32a1ca73ef05 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475" status: 200 len: 346 microversion: 2.1 time: 0.127120 Jul 19 20:49:00.476909 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:00 2022] GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475 => generated 346 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:00.486995 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-3793a95a-0d80-419b-8165-165822671529 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Action: 'create', calling method: .version_select at 0x7f2535ec6160>, body: {"snapshot": {"volume_id": "93992fc6-73e4-4f7b-ac41-0a9d1bb55475", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-149755466"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:00.523253 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-92595a06-6b76-405f-b91e-2d1f255958cf tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Calling method '.version_select at 0x7f2535ec68b0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:00.624822 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-92595a06-6b76-405f-b91e-2d1f255958cf tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399" status: 200 len: 353 microversion: 2.1 time: 0.105299 Jul 19 20:49:00.625409 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 5/8] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:00 2022] GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:00.642980 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9729e430-ae00-46a5-9029-c47bf7686d8c tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Calling method '.version_select at 0x7f2535ea5ca0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:00.768167 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9729e430-ae00-46a5-9029-c47bf7686d8c tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399" status: 200 len: 353 microversion: 2.1 time: 0.134393 Jul 19 20:49:00.790342 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 6/9] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:00 2022] GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:00.796399 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e2bd631a-61fb-4f8e-b137-28f7f6094c4d tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Calling method '.version_select at 0x7f2535ec6b80>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:00.988685 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-3793a95a-0d80-419b-8165-165822671529 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.510315 Jul 19 20:49:00.990123 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 4/10] 10.222.0.70 () {60 vars in 1161 bytes} [Tue Jul 19 20:49:00 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:01.000395 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5858bf65-32b5-4d11-99d4-fdacf6244ab7 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ec6dc0>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:01.305413 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e2bd631a-61fb-4f8e-b137-28f7f6094c4d tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399" status: 202 len: 0 microversion: 2.1 time: 0.513728 Jul 19 20:49:01.305996 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 7/11] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jul 19 20:49:00 2022] DELETE /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:49:01.313912 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-bca50cf7-b0fd-4a47-bac9-c4d35b2942db tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Calling method '.version_select at 0x7f2535ec6310>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:01.322334 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5858bf65-32b5-4d11-99d4-fdacf6244ab7 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea" status: 200 len: 286 microversion: 2.1 time: 0.325731 Jul 19 20:49:01.323099 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 5/12] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jul 19 20:49:00 2022] GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea => generated 286 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:49:01.334889 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-21dab871-d5c1-4438-a345-4e5dce81d7a1 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ec6c10>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:01.414572 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-bca50cf7-b0fd-4a47-bac9-c4d35b2942db tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399" status: 200 len: 352 microversion: 2.1 time: 0.104128 Jul 19 20:49:01.415573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 8/13] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:01 2022] GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:01.507567 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-21dab871-d5c1-4438-a345-4e5dce81d7a1 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.177883 Jul 19 20:49:01.508632 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 6/14] 10.222.0.70 () {58 vars in 1139 bytes} [Tue Jul 19 20:49:01 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:01.520123 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9cb0e8d4-863d-42db-860c-bd3a95ffc0fd tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ec63a0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:01.593531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9cb0e8d4-863d-42db-860c-bd3a95ffc0fd tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea" status: 200 len: 286 microversion: 2.1 time: 0.078492 Jul 19 20:49:01.595088 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 9/15] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jul 19 20:49:01 2022] GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:02.430050 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a2438697-df0b-419a-a9a5-99f8783e3f3d tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Calling method '.version_select at 0x7f2535eacf70>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:02.563107 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a2438697-df0b-419a-a9a5-99f8783e3f3d tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399" status: 200 len: 352 microversion: 2.1 time: 0.139755 Jul 19 20:49:02.565751 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 7/16] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:02 2022] GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 => generated 352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:02.607941 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a342b439-9f0e-4aa1-8289-9974ccb7c19c tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ec6a60>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:02.772274 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a342b439-9f0e-4aa1-8289-9974ccb7c19c tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea" status: 200 len: 286 microversion: 2.1 time: 0.168107 Jul 19 20:49:02.772833 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 10/17] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jul 19 20:49:02 2022] GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea => generated 286 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:03.578511 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4e8c4be8-3715-439e-a350-4f5577c9db2d tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Calling method '.version_select at 0x7f2535eacd30>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:03.680715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4e8c4be8-3715-439e-a350-4f5577c9db2d tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399" status: 200 len: 352 microversion: 2.1 time: 0.105995 Jul 19 20:49:03.681760 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 8/18] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:03 2022] GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:03.784499 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8374590d-0272-41f8-aef2-5febaba98690 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ea5c10>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:03.877549 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8374590d-0272-41f8-aef2-5febaba98690 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea" status: 200 len: 286 microversion: 2.1 time: 0.097271 Jul 19 20:49:03.878204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 11/19] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jul 19 20:49:03 2022] GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:04.698802 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-403e6943-6b5e-476d-8e40-df658b3d3413 tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Calling method '.version_select at 0x7f2535eac9d0>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:04.792134 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-403e6943-6b5e-476d-8e40-df658b3d3413 tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399" status: 200 len: 352 microversion: 2.1 time: 0.102350 Jul 19 20:49:04.793351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 9/20] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:04 2022] GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:04.890494 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-78f3e6bd-da99-47be-ba26-39686a7b80c3 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ed41f0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:04.974338 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-78f3e6bd-da99-47be-ba26-39686a7b80c3 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea" status: 200 len: 286 microversion: 2.1 time: 0.087896 Jul 19 20:49:04.975509 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 12/21] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jul 19 20:49:04 2022] GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:49:05.806551 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9430f40d-849a-4638-acd7-32d8d190e26f tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Calling method '.version_select at 0x7f2535ec6160>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:05.895187 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9430f40d-849a-4638-acd7-32d8d190e26f tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399" status: 200 len: 352 microversion: 2.1 time: 0.093195 Jul 19 20:49:05.900395 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 10/22] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:05 2022] GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:05.987007 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b1d287ec-ad84-418e-b2e3-5733df9087ab tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ea5af0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:06.059919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b1d287ec-ad84-418e-b2e3-5733df9087ab tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea" status: 200 len: 286 microversion: 2.1 time: 0.077358 Jul 19 20:49:06.060558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 13/23] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jul 19 20:49:05 2022] GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:06.863984 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1490545048", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "networks": [{"uuid": "619a8d45-ba37-4848-8c0d-6efe1ad4e380"}]}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:06.908139 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-fe5d23f7-ac1e-4f06-94e0-f3db3105f574 tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Calling method '.version_select at 0x7f2535ec6d30>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:06.978256 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-fe5d23f7-ac1e-4f06-94e0-f3db3105f574 tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399" status: 200 len: 352 microversion: 2.1 time: 0.073970 Jul 19 20:49:06.979150 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 14/24] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:06 2022] GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:49:07.030690 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.network.neutron [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] validate_networks() for [('619a8d45-ba37-4848-8c0d-6efe1ad4e380', None, None, None, None, None)] {{(pid=129867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:49:07.072625 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3ef3f68a-d0f3-48b9-9103-282284961397 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ec64c0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:07.119570 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3ef3f68a-d0f3-48b9-9103-282284961397 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea" status: 200 len: 286 microversion: 2.1 time: 0.051471 Jul 19 20:49:07.120147 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 15/25] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jul 19 20:49:07 2022] GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:49:07.994802 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b8f11e14-4f96-42da-bd08-82245846f8a6 tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Calling method '.version_select at 0x7f2535ed4430>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:08.093686 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-b8f11e14-4f96-42da-bd08-82245846f8a6 tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] HTTP exception thrown: Volume 3893e495-e08d-4256-a65b-f054b96b4399 could not be found. Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b8f11e14-4f96-42da-bd08-82245846f8a6 tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Request method failure captured: Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 HTTP/1.1 Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xi2a1TXz1jBhyQw8i2HzzT6UFGVJJkwr6uVAPSwdQy34D2y2IOqdqZleiLJiR8TbmtMfRzXvLKCQ7mo4DSLvBIiylCXFCEzxmvDoe1PHi-IvBlKSmFt8mmarST8HCjTXzJzhL8dky4mmHY-kYj_Ju-VscXv1iUOl66jeSOFBnZQzSs Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: d3f748e85ac34f358265448ab5167639 Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-VolumesGetTestJSON-1233779999 Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:49:08.099496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d3f748e85ac34f358265448ab5167639"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d3f748e85ac34f358265448ab5167639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d3f748e85ac34f358265448ab5167639"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d3f748e85ac34f358265448ab5167639", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-VolumesGetTestJSON-1233779999 Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: d3f748e85ac34f358265448ab5167639 Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-VolumesGetTestJSON-1233779999 Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-VolumesGetTestJSON-1233779999-project Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: a3827dae00a1476cb4a5f519fd4cf21b Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-VolumesGetTestJSON-1233779999-project Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Volume 3893e495-e08d-4256-a65b-f054b96b4399 could not be found. Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '3893e495-e08d-4256-a65b-f054b96b4399'} Jul 19 20:49:08.100835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3893e495-e08d-4256-a65b-f054b96b4399 could not be found. (HTTP 404) (Request-ID: req-1e186a20-ce88-4726-bcf4-f70da9760f8d) Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:08.101661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:49:08.102709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3893e495-e08d-4256-a65b-f054b96b4399 could not be found. Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:49:08.103810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:08.104859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3893e495-e08d-4256-a65b-f054b96b4399 could not be found. Jul 19 20:49:08.104859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:08.104859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:08.104859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:08.104859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:08.104859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:08.104859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:08.104859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:08.104859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:08.104859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3893e495-e08d-4256-a65b-f054b96b4399 could not be found. Jul 19 20:49:08.104859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:08.107281 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b8f11e14-4f96-42da-bd08-82245846f8a6 tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] Returning 404 to user: Volume 3893e495-e08d-4256-a65b-f054b96b4399 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:08.108290 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b8f11e14-4f96-42da-bd08-82245846f8a6 tempest-VolumesGetTestJSON-1233779999 tempest-VolumesGetTestJSON-1233779999-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399" status: 404 len: 109 microversion: 2.1 time: 0.121888 Jul 19 20:49:08.110126 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 16/26] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:07 2022] GET /compute/v2.1/os-volumes/3893e495-e08d-4256-a65b-f054b96b4399 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:49:08.140105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-cf1c450c-3144-42ba-a46e-0c96b3716afa tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ed4280>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:08.262055 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-cf1c450c-3144-42ba-a46e-0c96b3716afa tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea" status: 200 len: 287 microversion: 2.1 time: 0.132547 Jul 19 20:49:08.262622 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 17/27] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jul 19 20:49:08 2022] GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea => generated 287 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:49:08.275191 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d2d5cec4-c82b-464c-afea-a31d95025bed tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ea59d0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:08.313256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Flavor limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:49:08.314655 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Image limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:49:08.315064 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Flavor pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:49:08.315478 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Image pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:49:08.315892 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:49:08.355845 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:08.356333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:08.357160 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:08.363748 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:08.446270 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d2d5cec4-c82b-464c-afea-a31d95025bed tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea" status: 202 len: 0 microversion: 2.1 time: 0.176183 Jul 19 20:49:08.451713 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 18/28] 10.222.0.70 () {58 vars in 1253 bytes} [Tue Jul 19 20:49:08 2022] DELETE /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:49:08.458392 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-1c91c917-5c84-4452-afcc-33f5bb1d8d09 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ed44c0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:08.504158 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Getting quotas for project 0efbb2e43cc74d63ad721e3971e7b181. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:49:08.540891 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Getting quotas for user 20eed246b8e140688a628664f29e38a4 and project 0efbb2e43cc74d63ad721e3971e7b181. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:49:08.545836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-1c91c917-5c84-4452-afcc-33f5bb1d8d09 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea" status: 200 len: 286 microversion: 2.1 time: 0.090234 Jul 19 20:49:08.546928 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 19/29] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jul 19 20:49:08 2022] GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:08.602649 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Going to run 1 instances... {{(pid=129867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:49:08.609478 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:49:08.946556 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ffb7b00b-8f7f-403d-98c5-22cf971adfe8 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.233159 Jul 19 20:49:08.949248 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 11/30] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:49:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:49:08.973094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8b227430-006f-44a9-884f-990a0cdb6be9 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:08.974158 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8b227430-006f-44a9-884f-990a0cdb6be9 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:09.335082 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-8b227430-006f-44a9-884f-990a0cdb6be9 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:09.403603 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8b227430-006f-44a9-884f-990a0cdb6be9 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1215 microversion: 2.1 time: 0.438006 Jul 19 20:49:09.426530 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 20/31] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:08 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1215 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:09.558970 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-846dfb0b-752b-4ffa-bc2b-eed2f69de571 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535dc9670>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:09.622181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-846dfb0b-752b-4ffa-bc2b-eed2f69de571 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] HTTP exception thrown: Snapshot 36f1703f-e3ba-4979-a3f3-24e940b6a1ea could not be found. Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-846dfb0b-752b-4ffa-bc2b-eed2f69de571 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Request method failure captured: Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea HTTP/1.1 Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xi26wVhOdqGxIgPgEXY4I5LPWhMBEDkEyKcaLrk-N7mpx0EyVnCC2PP-Wy6SfhiWNw6AokaeeDVtYwKTg_FYFuRkYWD_vBKB_YYgE9nQBwCLVzJu9_KdjYER_2ZNbfpXLa0l7YTOyg9q0iKMp3bgvmvve1bRsiWouRJ3mjIg9BwMQE Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 26af6697fa9045cd9e7f41d5c2feb9cf Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1474805131 Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:49:09.632022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/26af6697fa9045cd9e7f41d5c2feb9cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26af6697fa9045cd9e7f41d5c2feb9cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26af6697fa9045cd9e7f41d5c2feb9cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_26af6697fa9045cd9e7f41d5c2feb9cf", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1474805131 Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 26af6697fa9045cd9e7f41d5c2feb9cf Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1474805131 Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-VolumesSnapshotsTestJSON-1474805131-project Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: 4d4f31197f3f4447b39ece90120c5449 Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1474805131-project Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Snapshot 36f1703f-e3ba-4979-a3f3-24e940b6a1ea could not be found. Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '36f1703f-e3ba-4979-a3f3-24e940b6a1ea'} Jul 19 20:49:09.633285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 36f1703f-e3ba-4979-a3f3-24e940b6a1ea could not be found. (HTTP 404) (Request-ID: req-86da2b2f-127b-461e-b91e-356d09244990) Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:09.633956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:49:09.634826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 36f1703f-e3ba-4979-a3f3-24e940b6a1ea could not be found. Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 19 20:49:09.635706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:09.636613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 36f1703f-e3ba-4979-a3f3-24e940b6a1ea could not be found. Jul 19 20:49:09.636613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:09.636613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:09.636613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:09.636613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:09.636613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:09.636613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:09.636613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:09.636613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:09.636613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 36f1703f-e3ba-4979-a3f3-24e940b6a1ea could not be found. Jul 19 20:49:09.636613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:09.636613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-846dfb0b-752b-4ffa-bc2b-eed2f69de571 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Returning 404 to user: Snapshot 36f1703f-e3ba-4979-a3f3-24e940b6a1ea could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:09.637175 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-846dfb0b-752b-4ffa-bc2b-eed2f69de571 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea" status: 404 len: 111 microversion: 2.1 time: 0.082624 Jul 19 20:49:09.638738 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 12/32] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jul 19 20:49:09 2022] GET /compute/v2.1/os-snapshots/36f1703f-e3ba-4979-a3f3-24e940b6a1ea => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:49:09.652938 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f56ea462-7474-4b6d-b264-e2236e1c730c tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f25368420d0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:09.969592 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f56ea462-7474-4b6d-b264-e2236e1c730c tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475" status: 202 len: 0 microversion: 2.1 time: 0.322905 Jul 19 20:49:09.974638 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 21/33] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jul 19 20:49:09 2022] DELETE /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:49:09.983875 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-969a44e9-7b79-4340-8219-f84b2cd18b91 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535ecd5e0>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:10.203013 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-969a44e9-7b79-4340-8219-f84b2cd18b91 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475" status: 200 len: 345 microversion: 2.1 time: 0.226363 Jul 19 20:49:10.203927 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 13/34] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:09 2022] GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475 => generated 345 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:10.441405 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-529e6f13-04b9-49f2-835b-1be44eff6d0e tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:10.443364 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-529e6f13-04b9-49f2-835b-1be44eff6d0e tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:10.660983 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-529e6f13-04b9-49f2-835b-1be44eff6d0e tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:10.675163 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-529e6f13-04b9-49f2-835b-1be44eff6d0e tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1215 microversion: 2.1 time: 0.246163 Jul 19 20:49:10.677063 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 22/35] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:10 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:11.218237 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9bc683b2-5fd5-42db-8b22-d35e5d8cc90b tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535dc9160>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:11.281270 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-9bc683b2-5fd5-42db-8b22-d35e5d8cc90b tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] HTTP exception thrown: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9bc683b2-5fd5-42db-8b22-d35e5d8cc90b tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Request method failure captured: Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475 HTTP/1.1 Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xi26wVhOdqGxIgPgEXY4I5LPWhMBEDkEyKcaLrk-N7mpx0EyVnCC2PP-Wy6SfhiWNw6AokaeeDVtYwKTg_FYFuRkYWD_vBKB_YYgE9nQBwCLVzJu9_KdjYER_2ZNbfpXLa0l7YTOyg9q0iKMp3bgvmvve1bRsiWouRJ3mjIg9BwMQE Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 26af6697fa9045cd9e7f41d5c2feb9cf Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1474805131 Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:49:11.284197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/26af6697fa9045cd9e7f41d5c2feb9cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26af6697fa9045cd9e7f41d5c2feb9cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26af6697fa9045cd9e7f41d5c2feb9cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_26af6697fa9045cd9e7f41d5c2feb9cf", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1474805131 Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 26af6697fa9045cd9e7f41d5c2feb9cf Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1474805131 Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-VolumesSnapshotsTestJSON-1474805131-project Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: 4d4f31197f3f4447b39ece90120c5449 Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1474805131-project Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '93992fc6-73e4-4f7b-ac41-0a9d1bb55475'} Jul 19 20:49:11.285233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. (HTTP 404) (Request-ID: req-8033a959-70dd-4ada-b369-a28621e85d6b) Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.286227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:49:11.287181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:49:11.288065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9bc683b2-5fd5-42db-8b22-d35e5d8cc90b tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Returning 404 to user: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9bc683b2-5fd5-42db-8b22-d35e5d8cc90b tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475" status: 404 len: 109 microversion: 2.1 time: 0.074004 Jul 19 20:49:11.288937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 14/36] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:11 2022] GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:49:11.309962 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b1670c0e-8918-4047-a343-d957db530780 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535defb80>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:11.384874 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-b1670c0e-8918-4047-a343-d957db530780 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] HTTP exception thrown: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b1670c0e-8918-4047-a343-d957db530780 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Request method failure captured: Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: DELETE /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475 HTTP/1.1 Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xi26wVhOdqGxIgPgEXY4I5LPWhMBEDkEyKcaLrk-N7mpx0EyVnCC2PP-Wy6SfhiWNw6AokaeeDVtYwKTg_FYFuRkYWD_vBKB_YYgE9nQBwCLVzJu9_KdjYER_2ZNbfpXLa0l7YTOyg9q0iKMp3bgvmvve1bRsiWouRJ3mjIg9BwMQE Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 26af6697fa9045cd9e7f41d5c2feb9cf Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1474805131 Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:49:11.387869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/26af6697fa9045cd9e7f41d5c2feb9cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26af6697fa9045cd9e7f41d5c2feb9cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26af6697fa9045cd9e7f41d5c2feb9cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_26af6697fa9045cd9e7f41d5c2feb9cf", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1474805131 Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 26af6697fa9045cd9e7f41d5c2feb9cf Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1474805131 Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-VolumesSnapshotsTestJSON-1474805131-project Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: 4d4f31197f3f4447b39ece90120c5449 Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1474805131-project Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '93992fc6-73e4-4f7b-ac41-0a9d1bb55475'} Jul 19 20:49:11.389171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. (HTTP 404) (Request-ID: req-67eb0c9e-5557-43fd-86d3-85f1cef80992) Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.390878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:49:11.391836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 20:49:11.395573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:11.398285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.398285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.398285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.398285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.398285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.398285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:11.398285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:11.398285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:11.398285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:11.398285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.398285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.401324 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b1670c0e-8918-4047-a343-d957db530780 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Returning 404 to user: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:11.403093 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b1670c0e-8918-4047-a343-d957db530780 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475" status: 404 len: 109 microversion: 2.1 time: 0.100108 Jul 19 20:49:11.404529 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 23/37] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jul 19 20:49:11 2022] DELETE /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:49:11.421800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-91894025-a973-401d-b126-f56561fb01f2 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Calling method '.version_select at 0x7f2535dc9c10>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:11.502352 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-91894025-a973-401d-b126-f56561fb01f2 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] HTTP exception thrown: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-91894025-a973-401d-b126-f56561fb01f2 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Request method failure captured: Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475 HTTP/1.1 Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xi26wVhOdqGxIgPgEXY4I5LPWhMBEDkEyKcaLrk-N7mpx0EyVnCC2PP-Wy6SfhiWNw6AokaeeDVtYwKTg_FYFuRkYWD_vBKB_YYgE9nQBwCLVzJu9_KdjYER_2ZNbfpXLa0l7YTOyg9q0iKMp3bgvmvve1bRsiWouRJ3mjIg9BwMQE Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 26af6697fa9045cd9e7f41d5c2feb9cf Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1474805131 Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:49:11.505238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/26af6697fa9045cd9e7f41d5c2feb9cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26af6697fa9045cd9e7f41d5c2feb9cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26af6697fa9045cd9e7f41d5c2feb9cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_26af6697fa9045cd9e7f41d5c2feb9cf", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1474805131 Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 26af6697fa9045cd9e7f41d5c2feb9cf Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1474805131 Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-VolumesSnapshotsTestJSON-1474805131-project Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: 4d4f31197f3f4447b39ece90120c5449 Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1474805131-project Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '93992fc6-73e4-4f7b-ac41-0a9d1bb55475'} Jul 19 20:49:11.506385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. (HTTP 404) (Request-ID: req-0795890c-4d92-4623-8072-fb6aca65b1b6) Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.507032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:49:11.507910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:49:11.508815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-91894025-a973-401d-b126-f56561fb01f2 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] Returning 404 to user: Volume 93992fc6-73e4-4f7b-ac41-0a9d1bb55475 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-91894025-a973-401d-b126-f56561fb01f2 tempest-VolumesSnapshotsTestJSON-1474805131 tempest-VolumesSnapshotsTestJSON-1474805131-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475" status: 404 len: 109 microversion: 2.1 time: 0.095702 Jul 19 20:49:11.511625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 15/38] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:49:11 2022] GET /compute/v2.1/os-volumes/93992fc6-73e4-4f7b-ac41-0a9d1bb55475 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:49:11.695679 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a8cc8c4b-ecd2-4d86-acf8-f23f4992e496 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:11.696965 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a8cc8c4b-ecd2-4d86-acf8-f23f4992e496 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:11.933439 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-a8cc8c4b-ecd2-4d86-acf8-f23f4992e496 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:11.945273 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a8cc8c4b-ecd2-4d86-acf8-f23f4992e496 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1215 microversion: 2.1 time: 0.254947 Jul 19 20:49:11.947395 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 24/39] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:11 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1215 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:12.964975 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e2512cc8-2c61-4c2b-8103-b2545e472534 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:12.966009 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e2512cc8-2c61-4c2b-8103-b2545e472534 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:12.984483 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2512cc8-2c61-4c2b-8103-b2545e472534 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:12.984942 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2512cc8-2c61-4c2b-8103-b2545e472534 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:12.985833 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2512cc8-2c61-4c2b-8103-b2545e472534 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:12.991239 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2512cc8-2c61-4c2b-8103-b2545e472534 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:13.489027 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1608674184", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:13.666913 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.network.neutron [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] validate_networks() for [('2e54078f-19e8-413b-aba4-4db8046602ff', None, None, None, None, None)] {{(pid=129867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:49:13.684725 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e2512cc8-2c61-4c2b-8103-b2545e472534 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:13.732744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e2512cc8-2c61-4c2b-8103-b2545e472534 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1267 microversion: 2.1 time: 0.771972 Jul 19 20:49:13.738547 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 25/40] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:12 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1267 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:14.759385 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-bb1e7dbe-e52b-4352-a6ea-d2b62b405ab0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:14.760175 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-bb1e7dbe-e52b-4352-a6ea-d2b62b405ab0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:14.778148 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bb1e7dbe-e52b-4352-a6ea-d2b62b405ab0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:14.778148 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bb1e7dbe-e52b-4352-a6ea-d2b62b405ab0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:14.785324 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bb1e7dbe-e52b-4352-a6ea-d2b62b405ab0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:14.790839 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bb1e7dbe-e52b-4352-a6ea-d2b62b405ab0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:15.435236 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-bb1e7dbe-e52b-4352-a6ea-d2b62b405ab0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:15.459307 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-bb1e7dbe-e52b-4352-a6ea-d2b62b405ab0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1273 microversion: 2.1 time: 0.707401 Jul 19 20:49:15.462283 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 26/41] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:14 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1273 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:16.481787 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-65166e99-9250-4db5-8613-9ef5a3b77671 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:16.484311 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-65166e99-9250-4db5-8613-9ef5a3b77671 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:16.521551 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-65166e99-9250-4db5-8613-9ef5a3b77671 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:16.522262 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-65166e99-9250-4db5-8613-9ef5a3b77671 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:16.523095 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-65166e99-9250-4db5-8613-9ef5a3b77671 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:16.523572 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-65166e99-9250-4db5-8613-9ef5a3b77671 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:16.882188 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Flavor limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:49:16.882759 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Image limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:49:16.883213 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Flavor pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:49:16.883623 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Image pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:49:16.884044 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:49:16.928195 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:16.929806 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:16.931656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:16.932164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:16.978089 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Getting quotas for project 6cc474e26dd8444b99645279c4d133bf. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:49:16.992972 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Getting quotas for user 9fa96f51390e46e991c6e9afa385d2f7 and project 6cc474e26dd8444b99645279c4d133bf. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:49:17.007653 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Going to run 1 instances... {{(pid=129867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:49:17.011095 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:49:17.125652 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d4ddbb5e-5e90-46db-87b8-50b018ff6ba6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.547810 Jul 19 20:49:17.131825 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 16/42] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:49:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 4552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:49:17.235401 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-65166e99-9250-4db5-8613-9ef5a3b77671 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:17.251893 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-65166e99-9250-4db5-8613-9ef5a3b77671 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1273 microversion: 2.1 time: 0.774578 Jul 19 20:49:17.262542 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 27/43] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:16 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1273 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:17.288060 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f2bf0fe9-1cc8-421e-ac97-9490c562a574 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:17.298387 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f2bf0fe9-1cc8-421e-ac97-9490c562a574 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:17.578967 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f2bf0fe9-1cc8-421e-ac97-9490c562a574 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:17.593993 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f2bf0fe9-1cc8-421e-ac97-9490c562a574 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1222 microversion: 2.1 time: 0.328749 Jul 19 20:49:17.594608 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 28/44] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:17 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1222 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:18.033944 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7affa9f6-0f86-41ff-9aef-094011a64d58 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: .version_select at 0x7f2534d354c0>, body: {"keypair": {"name": "tempest-keypair-1321512039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDCA1fXzdq6A0Ti8VhNIopokCnexkQGxEd8S61y3o5P2i7krjUkv7SylU13Vg8SsbtxwelvVI5dkH49Nss3Hlvaje+qC3CUri68obj2YozYV5P6aygDFFvU0lX/Rh2U8A=="}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:18.126976 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-7affa9f6-0f86-41ff-9aef-094011a64d58 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for project 5da6c42976154440bd0459beb12477f2. Resources: {'key_pairs'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:49:18.140142 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-7affa9f6-0f86-41ff-9aef-094011a64d58 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for user af989ff6dc024ff19023e6f633915ec3 and project 5da6c42976154440bd0459beb12477f2. Resources: {'key_pairs'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:49:18.258314 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7affa9f6-0f86-41ff-9aef-094011a64d58 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.126241 Jul 19 20:49:18.260704 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 17/45] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jul 19 20:49:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:18.316860 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-369cf379-6d7d-4c40-b33a-d2e259d77d22 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:18.317556 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-369cf379-6d7d-4c40-b33a-d2e259d77d22 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:18.384132 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-369cf379-6d7d-4c40-b33a-d2e259d77d22 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:18.391351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-369cf379-6d7d-4c40-b33a-d2e259d77d22 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:18.393399 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-369cf379-6d7d-4c40-b33a-d2e259d77d22 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:18.397180 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-369cf379-6d7d-4c40-b33a-d2e259d77d22 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:19.028432 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-369cf379-6d7d-4c40-b33a-d2e259d77d22 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:19.083429 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-369cf379-6d7d-4c40-b33a-d2e259d77d22 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1273 microversion: 2.1 time: 0.797527 Jul 19 20:49:19.084078 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 18/46] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:18 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1273 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:19.099033 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-150215453", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:19.175722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.network.neutron [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] validate_networks() for [('2e54078f-19e8-413b-aba4-4db8046602ff', None, None, None, None, None)] {{(pid=129867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:49:19.738359 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dce0ab4d-9efd-4b95-be44-881840fa768f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Action: 'create', calling method: .version_select at 0x7f2535d559d0>, body: {"keypair": {"name": "tempest-keypair-516235679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkiJSgKXKuT8cxbwrIgR5vR4PJ2unCo/2FYgBttq+dXto/kbu9BohlV0l5iB+BlbdMoUQlcwCa/Jr+a0qzermvSjGfBJY19Tn0u6z4DHMWyg/siefEKm6O7BkUSrJ8pgg=="}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:19.902719 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-dce0ab4d-9efd-4b95-be44-881840fa768f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Getting quotas for project 8298856e2d28408296cc7e4deca84846. Resources: {'key_pairs'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:49:19.917918 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-dce0ab4d-9efd-4b95-be44-881840fa768f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Getting quotas for user 31790576f8734f75adbbd8e9c0d61721 and project 8298856e2d28408296cc7e4deca84846. Resources: {'key_pairs'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:49:20.023826 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dce0ab4d-9efd-4b95-be44-881840fa768f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.842932 Jul 19 20:49:20.024793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 29/47] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jul 19 20:49:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1845 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 20:49:20.103803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0eb92e7a-97db-4cc8-a574-7d7f9899fa94 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:20.104438 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0eb92e7a-97db-4cc8-a574-7d7f9899fa94 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:20.128640 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0eb92e7a-97db-4cc8-a574-7d7f9899fa94 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:20.129099 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0eb92e7a-97db-4cc8-a574-7d7f9899fa94 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:20.130555 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0eb92e7a-97db-4cc8-a574-7d7f9899fa94 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:20.131028 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0eb92e7a-97db-4cc8-a574-7d7f9899fa94 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:20.968403 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0eb92e7a-97db-4cc8-a574-7d7f9899fa94 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:20.995385 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0eb92e7a-97db-4cc8-a574-7d7f9899fa94 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.892905 Jul 19 20:49:21.006976 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 30/48] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:20 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:21.258496 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Flavor limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:49:21.259113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Image limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:49:21.259397 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Flavor pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:49:21.259810 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Image pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:49:21.260228 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:49:21.297538 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:21.298254 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:21.299174 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:21.306771 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:21.405296 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Getting quotas for project 6cc474e26dd8444b99645279c4d133bf. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:49:21.420547 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Getting quotas for user 9fa96f51390e46e991c6e9afa385d2f7 and project 6cc474e26dd8444b99645279c4d133bf. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:49:21.472698 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Going to run 1 instances... {{(pid=129867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:49:21.476950 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:49:21.710315 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-71c3fdf5-e7a6-4167-848f-4d646c9a5a53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.615430 Jul 19 20:49:21.728350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-80ea767e-d89f-4844-afa0-9802f2c44d53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:21.729228 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-80ea767e-d89f-4844-afa0-9802f2c44d53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:21.739276 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 19/49] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:49:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:49:22.019071 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-da398097-d248-42fb-b7cc-70167518dfa1 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:22.019976 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-da398097-d248-42fb-b7cc-70167518dfa1 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:22.038321 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-da398097-d248-42fb-b7cc-70167518dfa1 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:22.039669 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-da398097-d248-42fb-b7cc-70167518dfa1 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:22.041261 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-da398097-d248-42fb-b7cc-70167518dfa1 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:22.043563 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-da398097-d248-42fb-b7cc-70167518dfa1 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:23.321863 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-80ea767e-d89f-4844-afa0-9802f2c44d53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:23.333980 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-80ea767e-d89f-4844-afa0-9802f2c44d53 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1221 microversion: 2.1 time: 1.608335 Jul 19 20:49:23.336252 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 31/50] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:21 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1221 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:24.361655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-1b20a75a-3f9f-4564-bddf-bbd370d2c3b9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:24.362710 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-1b20a75a-3f9f-4564-bddf-bbd370d2c3b9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:24.393208 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1b20a75a-3f9f-4564-bddf-bbd370d2c3b9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:24.409222 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1b20a75a-3f9f-4564-bddf-bbd370d2c3b9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:24.412939 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1b20a75a-3f9f-4564-bddf-bbd370d2c3b9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:24.414968 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1b20a75a-3f9f-4564-bddf-bbd370d2c3b9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:24.992418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-1b20a75a-3f9f-4564-bddf-bbd370d2c3b9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:25.073464 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-1b20a75a-3f9f-4564-bddf-bbd370d2c3b9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1279 microversion: 2.1 time: 0.712803 Jul 19 20:49:25.077825 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 32/51] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:24 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1279 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:26.042084 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-da398097-d248-42fb-b7cc-70167518dfa1 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:26.069551 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-da398097-d248-42fb-b7cc-70167518dfa1 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 4.053519 Jul 19 20:49:26.073849 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 20/52] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:22 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 4059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:26.097190 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ff63a7f7-e42b-4663-b04d-f44489cc8276 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:26.098757 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ff63a7f7-e42b-4663-b04d-f44489cc8276 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:26.130367 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ff63a7f7-e42b-4663-b04d-f44489cc8276 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:26.130942 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ff63a7f7-e42b-4663-b04d-f44489cc8276 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:26.131868 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ff63a7f7-e42b-4663-b04d-f44489cc8276 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:26.132337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ff63a7f7-e42b-4663-b04d-f44489cc8276 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:27.103389 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d922908a-0d34-476a-bf8a-9eb949c155fd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:27.118182 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d922908a-0d34-476a-bf8a-9eb949c155fd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:27.168595 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d922908a-0d34-476a-bf8a-9eb949c155fd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:27.171362 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d922908a-0d34-476a-bf8a-9eb949c155fd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:27.175506 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d922908a-0d34-476a-bf8a-9eb949c155fd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:27.180085 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d922908a-0d34-476a-bf8a-9eb949c155fd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:27.450806 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ff63a7f7-e42b-4663-b04d-f44489cc8276 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:27.463564 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ff63a7f7-e42b-4663-b04d-f44489cc8276 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1279 microversion: 2.1 time: 1.371793 Jul 19 20:49:27.482031 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 33/53] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:26 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1279 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:28.344144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-4798ec33-9802-4ff2-bd48-c563faa63775 req-10fcb2b9-1e6a-4b4a-a9db-64253d8727c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b03a24-f1b1-4dd1-bbe4-2e017296709b", "tag": "a318c0fd-56e8-453b-891c-8f0d834e4c18"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:28.386492 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-4798ec33-9802-4ff2-bd48-c563faa63775 req-10fcb2b9-1e6a-4b4a-a9db-64253d8727c4 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:28.392517 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-4798ec33-9802-4ff2-bd48-c563faa63775 req-10fcb2b9-1e6a-4b4a-a9db-64253d8727c4 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:28.447543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-4798ec33-9802-4ff2-bd48-c563faa63775 req-10fcb2b9-1e6a-4b4a-a9db-64253d8727c4 service nova] Creating event network-changed:a318c0fd-56e8-453b-891c-8f0d834e4c18 for instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b on hv-cinder-79987 Jul 19 20:49:28.449968 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-4798ec33-9802-4ff2-bd48-c563faa63775 req-10fcb2b9-1e6a-4b4a-a9db-64253d8727c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129866) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 20:49:28.451431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8c256550-1fab-4074-bdd2-927b3ea7eb14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:28.452639 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8c256550-1fab-4074-bdd2-927b3ea7eb14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:28.458912 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8c256550-1fab-4074-bdd2-927b3ea7eb14 None None] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:28.459706 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8c256550-1fab-4074-bdd2-927b3ea7eb14 None None] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:28.482628 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.compute.rpcapi [None req-8c256550-1fab-4074-bdd2-927b3ea7eb14 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 20:49:28.486989 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8c256550-1fab-4074-bdd2-927b3ea7eb14 None None] Releasing lock "compute-rpcapi-router" {{(pid=129866) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 20:49:28.540306 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8c256550-1fab-4074-bdd2-927b3ea7eb14 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.614297 Jul 19 20:49:28.541252 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 34/54] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:49:28.549779 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0c250109-5149-43e9-bc94-1088c3d21dbe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:28.550958 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0c250109-5149-43e9-bc94-1088c3d21dbe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:28.588930 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0c250109-5149-43e9-bc94-1088c3d21dbe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:28.592376 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0c250109-5149-43e9-bc94-1088c3d21dbe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:28.593734 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0c250109-5149-43e9-bc94-1088c3d21dbe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:28.597956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0c250109-5149-43e9-bc94-1088c3d21dbe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:28.992591 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0c250109-5149-43e9-bc94-1088c3d21dbe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:29.006867 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0c250109-5149-43e9-bc94-1088c3d21dbe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1279 microversion: 2.1 time: 0.463978 Jul 19 20:49:29.010094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 35/55] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:28 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1279 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:29.345226 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d922908a-0d34-476a-bf8a-9eb949c155fd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:29.363733 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d922908a-0d34-476a-bf8a-9eb949c155fd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 2.275128 Jul 19 20:49:29.364539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 21/56] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:27 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:30.039119 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-afa53d30-6c62-405e-8a8f-387a410bbf16 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:30.039743 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-afa53d30-6c62-405e-8a8f-387a410bbf16 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:30.046804 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-afa53d30-6c62-405e-8a8f-387a410bbf16 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:30.047261 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-afa53d30-6c62-405e-8a8f-387a410bbf16 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:30.050499 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-afa53d30-6c62-405e-8a8f-387a410bbf16 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:30.051127 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-afa53d30-6c62-405e-8a8f-387a410bbf16 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:30.399116 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2908b2fb-9dd2-415b-8198-90efd086a2dd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:30.399891 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2908b2fb-9dd2-415b-8198-90efd086a2dd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:30.421676 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2908b2fb-9dd2-415b-8198-90efd086a2dd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:30.422318 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2908b2fb-9dd2-415b-8198-90efd086a2dd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:30.423888 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2908b2fb-9dd2-415b-8198-90efd086a2dd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:30.424526 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2908b2fb-9dd2-415b-8198-90efd086a2dd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:30.566262 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-afa53d30-6c62-405e-8a8f-387a410bbf16 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:30.580294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-afa53d30-6c62-405e-8a8f-387a410bbf16 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1279 microversion: 2.1 time: 0.540702 Jul 19 20:49:30.581599 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 36/57] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:30 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1279 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:30.915803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-573251610", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4988720a-c392-40ae-8d35-c194234e1fb1"}], "security_groups": [{"name": "tempest-securitygroup--1982079431"}], "key_name": "tempest-keypair-1321512039", "user_data": "}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:31.336697 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=6 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:31.450851 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.network.neutron [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] validate_networks() for [('4988720a-c392-40ae-8d35-c194234e1fb1', None, None, None, None, None)] {{(pid=129866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:49:31.457845 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=22 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:31.761139 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2908b2fb-9dd2-415b-8198-90efd086a2dd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:31.774843 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2908b2fb-9dd2-415b-8198-90efd086a2dd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 1.380406 Jul 19 20:49:31.775440 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 22/58] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:30 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:31.791145 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-24e20439-1ce4-40c9-a6f5-19920e1f76b1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:31.791682 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-24e20439-1ce4-40c9-a6f5-19920e1f76b1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:31.812276 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-24e20439-1ce4-40c9-a6f5-19920e1f76b1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:31.814401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-24e20439-1ce4-40c9-a6f5-19920e1f76b1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:31.815877 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-24e20439-1ce4-40c9-a6f5-19920e1f76b1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:31.816492 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-24e20439-1ce4-40c9-a6f5-19920e1f76b1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:32.336288 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-24e20439-1ce4-40c9-a6f5-19920e1f76b1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:32.412275 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-24e20439-1ce4-40c9-a6f5-19920e1f76b1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.627954 Jul 19 20:49:32.414179 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 23/59] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:31 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:32.452600 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-99303888", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30fadedb-1330-4e74-bc15-7d138c37f8ec"}], "security_groups": [{"name": "tempest-securitygroup--45300983"}], "key_name": "tempest-keypair-516235679", "user_data": "}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:32.894539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.network.neutron [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] validate_networks() for [('30fadedb-1330-4e74-bc15-7d138c37f8ec', None, None, None, None, None)] {{(pid=129867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:49:33.331997 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=14 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:33.882695 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Flavor limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:49:33.883120 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Image limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:49:33.884256 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Flavor pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:49:33.884823 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Image pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:49:33.885265 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:49:33.900431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:33.900886 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:33.908687 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:33.909267 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:33.971552 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for project 5da6c42976154440bd0459beb12477f2. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:49:33.996675 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for user af989ff6dc024ff19023e6f633915ec3 and project 5da6c42976154440bd0459beb12477f2. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:49:34.030188 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Going to run 1 instances... {{(pid=129866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:49:34.040820 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:49:34.175758 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d97ec7ea-6282-4e6e-b9f7-13d76dacb51c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.264346 Jul 19 20:49:34.177306 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 37/60] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:49:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 3267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:49:34.178976 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Flavor limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:49:34.179679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Image limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:49:34.180167 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Flavor pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:49:34.180586 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Image pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:49:34.181222 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:49:34.186708 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6f8a6281-931e-4fff-abd1-5f923a7b8cd9 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:34.189088 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6f8a6281-931e-4fff-abd1-5f923a7b8cd9 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:34.194664 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:34.195977 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:34.197388 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:34.198440 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:34.207722 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6f8a6281-931e-4fff-abd1-5f923a7b8cd9 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:34.208191 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6f8a6281-931e-4fff-abd1-5f923a7b8cd9 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:34.210831 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6f8a6281-931e-4fff-abd1-5f923a7b8cd9 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:34.215046 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6f8a6281-931e-4fff-abd1-5f923a7b8cd9 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:34.239574 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Getting quotas for project 8298856e2d28408296cc7e4deca84846. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:49:34.250141 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Getting quotas for user 31790576f8734f75adbbd8e9c0d61721 and project 8298856e2d28408296cc7e4deca84846. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:49:34.281300 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Going to run 1 instances... {{(pid=129867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:49:34.284346 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:49:34.432234 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-39688d0e-a936-4338-a83b-aa0c81168f35 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.001631 Jul 19 20:49:34.440511 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 24/61] 10.222.0.70 () {62 vars in 1187 bytes} [Tue Jul 19 20:49:32 2022] POST /compute/v2.1/servers => generated 400 bytes in 2026 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 20:49:34.447819 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a5f4fa59-d087-4c83-9b0a-817f9c5b7beb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:34.449167 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a5f4fa59-d087-4c83-9b0a-817f9c5b7beb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:34.459597 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a5f4fa59-d087-4c83-9b0a-817f9c5b7beb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:34.460381 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a5f4fa59-d087-4c83-9b0a-817f9c5b7beb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:34.463643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a5f4fa59-d087-4c83-9b0a-817f9c5b7beb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:34.465643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a5f4fa59-d087-4c83-9b0a-817f9c5b7beb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:34.522168 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6f8a6281-931e-4fff-abd1-5f923a7b8cd9 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:34.534931 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6f8a6281-931e-4fff-abd1-5f923a7b8cd9 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.355576 Jul 19 20:49:34.536102 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 38/62] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:34 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:34.801269 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a5f4fa59-d087-4c83-9b0a-817f9c5b7beb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:34.816026 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a5f4fa59-d087-4c83-9b0a-817f9c5b7beb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.373331 Jul 19 20:49:34.826855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 25/63] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:34 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:34.833814 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-1b97b0b5-84e4-40de-be5a-4c8d76cbef8f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:34.837985 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-1b97b0b5-84e4-40de-be5a-4c8d76cbef8f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:34.987197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1b97b0b5-84e4-40de-be5a-4c8d76cbef8f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:35.018884 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-1b97b0b5-84e4-40de-be5a-4c8d76cbef8f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1241 microversion: 2.1 time: 0.197258 Jul 19 20:49:35.021944 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 26/64] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:34 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1241 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:35.037667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b1528df3-3f48-4f7b-86da-accc8ba22932 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:35.040093 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b1528df3-3f48-4f7b-86da-accc8ba22932 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:35.132240 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-11dd364e-04d0-4e86-8d43-290d8c3887df req-7cd55a23-c25c-4a6b-860c-30db8465d484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07400b5-bd6a-4841-a97c-3c7e6704de6a", "tag": "1fd8ecd1-9064-4baf-96ff-c66e1f84b6b5"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:35.154073 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:35.171686 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b1528df3-3f48-4f7b-86da-accc8ba22932 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:35.175824 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-11dd364e-04d0-4e86-8d43-290d8c3887df req-7cd55a23-c25c-4a6b-860c-30db8465d484 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.177161 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-11dd364e-04d0-4e86-8d43-290d8c3887df req-7cd55a23-c25c-4a6b-860c-30db8465d484 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.183477 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b1528df3-3f48-4f7b-86da-accc8ba22932 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:35.185018 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b1528df3-3f48-4f7b-86da-accc8ba22932 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:35.186402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b1528df3-3f48-4f7b-86da-accc8ba22932 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1279 microversion: 2.20 time: 0.163052 Jul 19 20:49:35.186968 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 27/65] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:35 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:49:35.193787 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=61 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:35.213135 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-11dd364e-04d0-4e86-8d43-290d8c3887df req-7cd55a23-c25c-4a6b-860c-30db8465d484 service nova] Creating event network-changed:1fd8ecd1-9064-4baf-96ff-c66e1f84b6b5 for instance b07400b5-bd6a-4841-a97c-3c7e6704de6a on hv-cinder-79987 Jul 19 20:49:35.222553 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-11dd364e-04d0-4e86-8d43-290d8c3887df req-7cd55a23-c25c-4a6b-860c-30db8465d484 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.684344 Jul 19 20:49:35.226045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 39/66] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:35.555197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-64b8e945-21bd-493b-985a-980e0ea2f25d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:35.556032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-64b8e945-21bd-493b-985a-980e0ea2f25d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:35.583501 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-e3d0ca82-8845-4995-be2e-94a05c742f5e req-9cbfde48-a67e-40d0-a115-bfbd32f1e3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84348ad4-6efa-4243-b5af-b5d6994c316b", "tag": "7fd29114-ce93-4e34-847f-1dce713d7bb5"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:35.601495 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:35.606998 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-64b8e945-21bd-493b-985a-980e0ea2f25d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.609463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-64b8e945-21bd-493b-985a-980e0ea2f25d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.611351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-64b8e945-21bd-493b-985a-980e0ea2f25d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.616774 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-64b8e945-21bd-493b-985a-980e0ea2f25d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.630350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-e3d0ca82-8845-4995-be2e-94a05c742f5e req-9cbfde48-a67e-40d0-a115-bfbd32f1e3c2 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.635610 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-e3d0ca82-8845-4995-be2e-94a05c742f5e req-9cbfde48-a67e-40d0-a115-bfbd32f1e3c2 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.660230 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-e3d0ca82-8845-4995-be2e-94a05c742f5e req-9cbfde48-a67e-40d0-a115-bfbd32f1e3c2 service nova] Creating event network-changed:7fd29114-ce93-4e34-847f-1dce713d7bb5 for instance 84348ad4-6efa-4243-b5af-b5d6994c316b on hv-cinder-79987 Jul 19 20:49:35.669723 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-e3d0ca82-8845-4995-be2e-94a05c742f5e req-9cbfde48-a67e-40d0-a115-bfbd32f1e3c2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091015 Jul 19 20:49:35.674267 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 40/67] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:35.836096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ed316ca6-24c9-4ce7-9e1d-23b4d238b221 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:35.837100 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ed316ca6-24c9-4ce7-9e1d-23b4d238b221 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:35.851807 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed316ca6-24c9-4ce7-9e1d-23b4d238b221 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.852339 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed316ca6-24c9-4ce7-9e1d-23b4d238b221 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:35.853181 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed316ca6-24c9-4ce7-9e1d-23b4d238b221 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:35.853702 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed316ca6-24c9-4ce7-9e1d-23b4d238b221 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:36.184596 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-64b8e945-21bd-493b-985a-980e0ea2f25d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:36.190367 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=49 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:36.196591 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ed316ca6-24c9-4ce7-9e1d-23b4d238b221 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:36.210258 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ed316ca6-24c9-4ce7-9e1d-23b4d238b221 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.378397 Jul 19 20:49:36.214549 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-64b8e945-21bd-493b-985a-980e0ea2f25d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.663569 Jul 19 20:49:36.222534 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 41/68] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:35 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:36.229828 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 28/69] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:35 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:36.235889 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-89835f35-167c-42e5-8410-ae296296e5ff tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:36.236494 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-89835f35-167c-42e5-8410-ae296296e5ff tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:36.242449 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e6996ebb-f574-4d20-8a97-06051dd6d5ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:36.243214 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e6996ebb-f574-4d20-8a97-06051dd6d5ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:36.253882 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-89835f35-167c-42e5-8410-ae296296e5ff tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:36.254344 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-89835f35-167c-42e5-8410-ae296296e5ff tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:36.258378 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e6996ebb-f574-4d20-8a97-06051dd6d5ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:36.258827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e6996ebb-f574-4d20-8a97-06051dd6d5ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:36.259595 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e6996ebb-f574-4d20-8a97-06051dd6d5ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:36.260027 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e6996ebb-f574-4d20-8a97-06051dd6d5ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:36.263153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-89835f35-167c-42e5-8410-ae296296e5ff tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:36.263696 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-89835f35-167c-42e5-8410-ae296296e5ff tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:36.369034 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e6996ebb-f574-4d20-8a97-06051dd6d5ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:36.371890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-89835f35-167c-42e5-8410-ae296296e5ff tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:36.379018 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e6996ebb-f574-4d20-8a97-06051dd6d5ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:36.381996 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e6996ebb-f574-4d20-8a97-06051dd6d5ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:36.384283 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-89835f35-167c-42e5-8410-ae296296e5ff tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1245 microversion: 2.1 time: 0.160587 Jul 19 20:49:36.386687 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e6996ebb-f574-4d20-8a97-06051dd6d5ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1283 microversion: 2.20 time: 0.152591 Jul 19 20:49:36.396747 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 42/70] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:36 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1245 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:36.396964 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 29/71] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:36 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1283 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:49:37.231917 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-76a13354-6609-48a5-8cb1-e93437a87985 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:37.232543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-76a13354-6609-48a5-8cb1-e93437a87985 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:37.240118 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7a2820ea-2e90-4344-8b6e-a7a854df24be tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:37.240732 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7a2820ea-2e90-4344-8b6e-a7a854df24be tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:37.241797 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-76a13354-6609-48a5-8cb1-e93437a87985 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:37.242243 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-76a13354-6609-48a5-8cb1-e93437a87985 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:37.249319 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-76a13354-6609-48a5-8cb1-e93437a87985 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:37.249931 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-76a13354-6609-48a5-8cb1-e93437a87985 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:37.253663 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a2820ea-2e90-4344-8b6e-a7a854df24be tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:37.254122 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a2820ea-2e90-4344-8b6e-a7a854df24be tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:37.254907 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a2820ea-2e90-4344-8b6e-a7a854df24be tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:37.255349 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a2820ea-2e90-4344-8b6e-a7a854df24be tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:37.532552 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7a2820ea-2e90-4344-8b6e-a7a854df24be tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:37.549149 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-76a13354-6609-48a5-8cb1-e93437a87985 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:37.553112 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7a2820ea-2e90-4344-8b6e-a7a854df24be tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.305105 Jul 19 20:49:37.560755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-76a13354-6609-48a5-8cb1-e93437a87985 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.333534 Jul 19 20:49:37.561788 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 43/72] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:37 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:37.562087 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 30/73] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:37 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:37.567306 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5e751e03-9728-40e7-94b8-514e6ac2f85b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:37.568074 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5e751e03-9728-40e7-94b8-514e6ac2f85b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:37.568755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-bfe475e6-ea0c-40cc-a4c6-9646a43ff1f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:37.569383 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-bfe475e6-ea0c-40cc-a4c6-9646a43ff1f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:37.575375 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5e751e03-9728-40e7-94b8-514e6ac2f85b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:37.576151 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5e751e03-9728-40e7-94b8-514e6ac2f85b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:37.576401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bfe475e6-ea0c-40cc-a4c6-9646a43ff1f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:37.576856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bfe475e6-ea0c-40cc-a4c6-9646a43ff1f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:37.577661 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bfe475e6-ea0c-40cc-a4c6-9646a43ff1f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:37.577819 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5e751e03-9728-40e7-94b8-514e6ac2f85b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:37.578105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bfe475e6-ea0c-40cc-a4c6-9646a43ff1f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:37.578522 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5e751e03-9728-40e7-94b8-514e6ac2f85b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:37.649993 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-bfe475e6-ea0c-40cc-a4c6-9646a43ff1f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:37.661604 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-bfe475e6-ea0c-40cc-a4c6-9646a43ff1f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:37.663206 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-bfe475e6-ea0c-40cc-a4c6-9646a43ff1f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:37.664333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-bfe475e6-ea0c-40cc-a4c6-9646a43ff1f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1331 microversion: 2.20 time: 0.099322 Jul 19 20:49:37.675228 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 31/74] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:37 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:49:37.705936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5e751e03-9728-40e7-94b8-514e6ac2f85b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:37.713313 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5e751e03-9728-40e7-94b8-514e6ac2f85b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1293 microversion: 2.1 time: 0.150513 Jul 19 20:49:37.713917 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 44/75] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:37 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1293 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:38.573083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-3472d5a8-3104-448f-9efa-e91c617c76a9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:38.573083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-3472d5a8-3104-448f-9efa-e91c617c76a9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:38.579030 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-26cb921e-a97e-47b0-ad5a-136f2556f1b5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:38.579546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3472d5a8-3104-448f-9efa-e91c617c76a9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:38.579720 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3472d5a8-3104-448f-9efa-e91c617c76a9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:38.580433 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3472d5a8-3104-448f-9efa-e91c617c76a9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:38.580875 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3472d5a8-3104-448f-9efa-e91c617c76a9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:38.581203 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-26cb921e-a97e-47b0-ad5a-136f2556f1b5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:38.589403 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-26cb921e-a97e-47b0-ad5a-136f2556f1b5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:38.590208 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-26cb921e-a97e-47b0-ad5a-136f2556f1b5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:38.591617 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-26cb921e-a97e-47b0-ad5a-136f2556f1b5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:38.592775 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-26cb921e-a97e-47b0-ad5a-136f2556f1b5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:38.811884 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-26cb921e-a97e-47b0-ad5a-136f2556f1b5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:38.816196 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3472d5a8-3104-448f-9efa-e91c617c76a9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:38.825442 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-26cb921e-a97e-47b0-ad5a-136f2556f1b5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.250798 Jul 19 20:49:38.826203 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-3472d5a8-3104-448f-9efa-e91c617c76a9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.258243 Jul 19 20:49:38.826657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 45/76] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:38 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:38.831805 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ad661427-0822-4a81-97a4-da86ccdd5aae tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:38.832650 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ad661427-0822-4a81-97a4-da86ccdd5aae tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:38.836997 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 32/77] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:38 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:38.839766 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ad661427-0822-4a81-97a4-da86ccdd5aae tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:38.840263 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ad661427-0822-4a81-97a4-da86ccdd5aae tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:38.841319 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ad661427-0822-4a81-97a4-da86ccdd5aae tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:38.841963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ad661427-0822-4a81-97a4-da86ccdd5aae tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:38.842942 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-98fcf7ac-d29a-411a-812d-264808e3a20e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:38.843743 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-98fcf7ac-d29a-411a-812d-264808e3a20e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:38.854929 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-98fcf7ac-d29a-411a-812d-264808e3a20e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:38.857962 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-98fcf7ac-d29a-411a-812d-264808e3a20e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:38.859579 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-98fcf7ac-d29a-411a-812d-264808e3a20e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:38.860210 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-98fcf7ac-d29a-411a-812d-264808e3a20e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:38.966010 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-98fcf7ac-d29a-411a-812d-264808e3a20e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:38.967721 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ad661427-0822-4a81-97a4-da86ccdd5aae tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:38.978538 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ad661427-0822-4a81-97a4-da86ccdd5aae tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:38.979081 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-98fcf7ac-d29a-411a-812d-264808e3a20e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1293 microversion: 2.1 time: 0.140713 Jul 19 20:49:38.979728 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 33/78] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:38 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1293 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:38.980306 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ad661427-0822-4a81-97a4-da86ccdd5aae tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:38.987471 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ad661427-0822-4a81-97a4-da86ccdd5aae tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1331 microversion: 2.20 time: 0.159785 Jul 19 20:49:38.988050 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 46/79] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:38 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1331 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:49:39.844494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5de92433-00e2-4f0d-8bb5-5f368f25d2b0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:39.846045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7f36421b-c828-4aeb-94c0-c8e82e15bf36 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:39.846800 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-7f36421b-c828-4aeb-94c0-c8e82e15bf36 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:39.847781 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5de92433-00e2-4f0d-8bb5-5f368f25d2b0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:39.854849 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5de92433-00e2-4f0d-8bb5-5f368f25d2b0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:39.863641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5de92433-00e2-4f0d-8bb5-5f368f25d2b0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:39.865338 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5de92433-00e2-4f0d-8bb5-5f368f25d2b0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:39.866628 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5de92433-00e2-4f0d-8bb5-5f368f25d2b0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:39.869882 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7f36421b-c828-4aeb-94c0-c8e82e15bf36 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:39.874060 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7f36421b-c828-4aeb-94c0-c8e82e15bf36 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:39.877275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7f36421b-c828-4aeb-94c0-c8e82e15bf36 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:39.880500 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7f36421b-c828-4aeb-94c0-c8e82e15bf36 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:40.435962 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-7f36421b-c828-4aeb-94c0-c8e82e15bf36 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:40.437146 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5de92433-00e2-4f0d-8bb5-5f368f25d2b0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:40.448507 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-7f36421b-c828-4aeb-94c0-c8e82e15bf36 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.607869 Jul 19 20:49:40.450226 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5de92433-00e2-4f0d-8bb5-5f368f25d2b0 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.610464 Jul 19 20:49:40.450822 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 34/80] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:39 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:40.457790 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-df520d95-db2a-4e63-942f-0856ae8b1fa2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:40.458692 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-df520d95-db2a-4e63-942f-0856ae8b1fa2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:40.460260 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 47/81] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:39 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:40.465263 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-df520d95-db2a-4e63-942f-0856ae8b1fa2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:40.465863 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-df520d95-db2a-4e63-942f-0856ae8b1fa2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:40.466830 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-df520d95-db2a-4e63-942f-0856ae8b1fa2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:40.467664 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-df520d95-db2a-4e63-942f-0856ae8b1fa2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:40.470774 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3f108ef3-5bac-4bc7-8811-8e5a4656dcb5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:40.471389 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3f108ef3-5bac-4bc7-8811-8e5a4656dcb5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:40.490271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3f108ef3-5bac-4bc7-8811-8e5a4656dcb5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:40.490867 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3f108ef3-5bac-4bc7-8811-8e5a4656dcb5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:40.493770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3f108ef3-5bac-4bc7-8811-8e5a4656dcb5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:40.495030 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3f108ef3-5bac-4bc7-8811-8e5a4656dcb5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:40.586822 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-df520d95-db2a-4e63-942f-0856ae8b1fa2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:40.598127 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-df520d95-db2a-4e63-942f-0856ae8b1fa2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1299 microversion: 2.1 time: 0.146021 Jul 19 20:49:40.599572 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 35/82] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:40 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:40.622986 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3f108ef3-5bac-4bc7-8811-8e5a4656dcb5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:40.632338 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3f108ef3-5bac-4bc7-8811-8e5a4656dcb5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:40.633960 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3f108ef3-5bac-4bc7-8811-8e5a4656dcb5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:40.635241 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3f108ef3-5bac-4bc7-8811-8e5a4656dcb5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1337 microversion: 2.20 time: 0.169330 Jul 19 20:49:40.636067 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 48/83] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:40 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1337 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:49:41.467342 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f6763917-71c5-470b-b277-c60b2fa05174 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:41.468214 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f6763917-71c5-470b-b277-c60b2fa05174 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:41.468330 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5aabb4dd-fc0c-4b83-8d75-e1cd5c6f5a6a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:41.469041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5aabb4dd-fc0c-4b83-8d75-e1cd5c6f5a6a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:41.481923 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5aabb4dd-fc0c-4b83-8d75-e1cd5c6f5a6a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:41.482334 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f6763917-71c5-470b-b277-c60b2fa05174 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:41.482790 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f6763917-71c5-470b-b277-c60b2fa05174 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:41.484726 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5aabb4dd-fc0c-4b83-8d75-e1cd5c6f5a6a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:41.487008 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5aabb4dd-fc0c-4b83-8d75-e1cd5c6f5a6a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:41.488290 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5aabb4dd-fc0c-4b83-8d75-e1cd5c6f5a6a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:41.493215 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f6763917-71c5-470b-b277-c60b2fa05174 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:41.494904 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f6763917-71c5-470b-b277-c60b2fa05174 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:41.954341 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5aabb4dd-fc0c-4b83-8d75-e1cd5c6f5a6a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:41.967394 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5aabb4dd-fc0c-4b83-8d75-e1cd5c6f5a6a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.503348 Jul 19 20:49:41.970017 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 49/84] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:41 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:41.980603 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b3e3025f-f57c-4ccc-981d-f87752080b5b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:41.981207 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b3e3025f-f57c-4ccc-981d-f87752080b5b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:41.998947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b3e3025f-f57c-4ccc-981d-f87752080b5b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:41.999603 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b3e3025f-f57c-4ccc-981d-f87752080b5b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:42.000391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b3e3025f-f57c-4ccc-981d-f87752080b5b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:42.001808 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b3e3025f-f57c-4ccc-981d-f87752080b5b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:42.035572 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f6763917-71c5-470b-b277-c60b2fa05174 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:42.046109 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f6763917-71c5-470b-b277-c60b2fa05174 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.582992 Jul 19 20:49:42.061065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 36/85] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:41 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:42.080404 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-cff2a786-7107-4f71-a151-3fd193d72865 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:42.081392 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-cff2a786-7107-4f71-a151-3fd193d72865 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:42.103822 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cff2a786-7107-4f71-a151-3fd193d72865 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:42.106784 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cff2a786-7107-4f71-a151-3fd193d72865 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:42.107757 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cff2a786-7107-4f71-a151-3fd193d72865 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:42.110151 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cff2a786-7107-4f71-a151-3fd193d72865 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:42.209233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b3e3025f-f57c-4ccc-981d-f87752080b5b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:42.219591 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b3e3025f-f57c-4ccc-981d-f87752080b5b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1299 microversion: 2.1 time: 0.248356 Jul 19 20:49:42.220922 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 50/86] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:41 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1299 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:42.291226 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-cff2a786-7107-4f71-a151-3fd193d72865 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:42.307377 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-cff2a786-7107-4f71-a151-3fd193d72865 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:42.317776 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-cff2a786-7107-4f71-a151-3fd193d72865 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:42.319029 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-cff2a786-7107-4f71-a151-3fd193d72865 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1337 microversion: 2.20 time: 0.256429 Jul 19 20:49:42.319634 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 37/87] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:42 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1337 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:49:42.340251 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-53d1542a-e4a1-4b60-8d7b-b49a462dced5 req-90439679-e18a-4560-a942-d271a2cddf12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b03a24-f1b1-4dd1-bbe4-2e017296709b", "name": "network-vif-plugged", "status": "completed", "tag": "a318c0fd-56e8-453b-891c-8f0d834e4c18"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:42.356208 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-53d1542a-e4a1-4b60-8d7b-b49a462dced5 req-90439679-e18a-4560-a942-d271a2cddf12 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:42.356820 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-53d1542a-e4a1-4b60-8d7b-b49a462dced5 req-90439679-e18a-4560-a942-d271a2cddf12 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:42.384237 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-53d1542a-e4a1-4b60-8d7b-b49a462dced5 req-90439679-e18a-4560-a942-d271a2cddf12 service nova] Creating event network-vif-plugged:a318c0fd-56e8-453b-891c-8f0d834e4c18 for instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b on hv-cinder-79987 Jul 19 20:49:42.394832 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-53d1542a-e4a1-4b60-8d7b-b49a462dced5 req-90439679-e18a-4560-a942-d271a2cddf12 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171686 Jul 19 20:49:42.402681 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 51/88] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:42.988431 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-04814a6a-c33e-4fbb-88be-5640baaad9f5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:42.989834 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-04814a6a-c33e-4fbb-88be-5640baaad9f5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:43.002013 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-04814a6a-c33e-4fbb-88be-5640baaad9f5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:43.006174 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-04814a6a-c33e-4fbb-88be-5640baaad9f5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:43.007255 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-04814a6a-c33e-4fbb-88be-5640baaad9f5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:43.008185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-04814a6a-c33e-4fbb-88be-5640baaad9f5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:43.066523 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-daded926-e403-4ff4-b09a-a85966338834 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:43.067462 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-daded926-e403-4ff4-b09a-a85966338834 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:43.085078 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-daded926-e403-4ff4-b09a-a85966338834 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:43.085708 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-daded926-e403-4ff4-b09a-a85966338834 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:43.086713 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-daded926-e403-4ff4-b09a-a85966338834 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:43.087148 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-daded926-e403-4ff4-b09a-a85966338834 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:43.300207 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-04814a6a-c33e-4fbb-88be-5640baaad9f5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:43.309956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-04814a6a-c33e-4fbb-88be-5640baaad9f5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.327188 Jul 19 20:49:43.315632 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 38/89] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:42 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:43.333841 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-df42f169-b8b5-49f1-b7f3-6e8fb290ab6b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:43.338854 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-df42f169-b8b5-49f1-b7f3-6e8fb290ab6b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:43.361312 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-df42f169-b8b5-49f1-b7f3-6e8fb290ab6b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:43.361793 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-df42f169-b8b5-49f1-b7f3-6e8fb290ab6b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:43.362590 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-df42f169-b8b5-49f1-b7f3-6e8fb290ab6b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:43.363033 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-df42f169-b8b5-49f1-b7f3-6e8fb290ab6b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:43.393966 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-daded926-e403-4ff4-b09a-a85966338834 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:43.406705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-daded926-e403-4ff4-b09a-a85966338834 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.345152 Jul 19 20:49:43.407667 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 52/90] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:43 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:43.413114 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5f110793-f5c7-4e17-b3ca-4f558b851ba5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:43.414153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5f110793-f5c7-4e17-b3ca-4f558b851ba5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:43.420665 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f110793-f5c7-4e17-b3ca-4f558b851ba5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:43.421455 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f110793-f5c7-4e17-b3ca-4f558b851ba5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:43.423415 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f110793-f5c7-4e17-b3ca-4f558b851ba5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:43.424545 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f110793-f5c7-4e17-b3ca-4f558b851ba5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:43.708564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-df42f169-b8b5-49f1-b7f3-6e8fb290ab6b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:43.723580 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-df42f169-b8b5-49f1-b7f3-6e8fb290ab6b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.403336 Jul 19 20:49:43.725311 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 39/91] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:43 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:43.741396 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5f110793-f5c7-4e17-b3ca-4f558b851ba5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:43.751294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5f110793-f5c7-4e17-b3ca-4f558b851ba5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:43.753187 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5f110793-f5c7-4e17-b3ca-4f558b851ba5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:43.754586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5f110793-f5c7-4e17-b3ca-4f558b851ba5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.345777 Jul 19 20:49:43.755221 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 53/92] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:43 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:49:44.332234 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-188217c5-4422-49f0-9cc6-64431b9acf08 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:44.332851 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-188217c5-4422-49f0-9cc6-64431b9acf08 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:44.334728 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:44.340084 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-188217c5-4422-49f0-9cc6-64431b9acf08 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:44.340540 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-188217c5-4422-49f0-9cc6-64431b9acf08 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:44.341542 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-188217c5-4422-49f0-9cc6-64431b9acf08 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:44.342142 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-188217c5-4422-49f0-9cc6-64431b9acf08 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:44.423887 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4d6f5cb4-8fa3-4332-a440-3402834b346d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:44.425008 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4d6f5cb4-8fa3-4332-a440-3402834b346d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:44.428219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=4 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:44.429222 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=6 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:44.434299 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4d6f5cb4-8fa3-4332-a440-3402834b346d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:44.435568 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4d6f5cb4-8fa3-4332-a440-3402834b346d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:44.436401 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4d6f5cb4-8fa3-4332-a440-3402834b346d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:44.436990 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4d6f5cb4-8fa3-4332-a440-3402834b346d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:44.681315 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-188217c5-4422-49f0-9cc6-64431b9acf08 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:44.693864 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-188217c5-4422-49f0-9cc6-64431b9acf08 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.365746 Jul 19 20:49:44.695328 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 40/93] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:44 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:44.757567 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-804dd551-fba2-4574-9bd7-98c74f957ab4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:44.765258 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-804dd551-fba2-4574-9bd7-98c74f957ab4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:44.779264 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-804dd551-fba2-4574-9bd7-98c74f957ab4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:44.779479 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4d6f5cb4-8fa3-4332-a440-3402834b346d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:44.779790 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-804dd551-fba2-4574-9bd7-98c74f957ab4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:44.780811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-804dd551-fba2-4574-9bd7-98c74f957ab4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:44.781522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-804dd551-fba2-4574-9bd7-98c74f957ab4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:44.787674 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4d6f5cb4-8fa3-4332-a440-3402834b346d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.367657 Jul 19 20:49:44.789892 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 54/94] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:44 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:44.800724 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-fa9a2fd7-3087-4bdb-b94a-1a18c1885f66 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:44.802298 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-fa9a2fd7-3087-4bdb-b94a-1a18c1885f66 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:44.821935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fa9a2fd7-3087-4bdb-b94a-1a18c1885f66 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:44.822696 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fa9a2fd7-3087-4bdb-b94a-1a18c1885f66 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:44.823828 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fa9a2fd7-3087-4bdb-b94a-1a18c1885f66 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:44.825845 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fa9a2fd7-3087-4bdb-b94a-1a18c1885f66 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:45.025059 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-804dd551-fba2-4574-9bd7-98c74f957ab4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:45.032531 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-804dd551-fba2-4574-9bd7-98c74f957ab4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.293597 Jul 19 20:49:45.033585 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 41/95] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:44 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:45.042382 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-fa9a2fd7-3087-4bdb-b94a-1a18c1885f66 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:45.051820 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-fa9a2fd7-3087-4bdb-b94a-1a18c1885f66 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:45.051820 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-fa9a2fd7-3087-4bdb-b94a-1a18c1885f66 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:45.052466 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-fa9a2fd7-3087-4bdb-b94a-1a18c1885f66 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.260612 Jul 19 20:49:45.053065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 55/96] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:44 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:49:45.713236 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-10a47183-16ce-4138-8ad3-4f959d29c758 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:45.713866 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-10a47183-16ce-4138-8ad3-4f959d29c758 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:45.715684 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=10 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:45.722347 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-10a47183-16ce-4138-8ad3-4f959d29c758 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:45.723122 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-10a47183-16ce-4138-8ad3-4f959d29c758 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:45.723889 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-10a47183-16ce-4138-8ad3-4f959d29c758 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:45.724538 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-10a47183-16ce-4138-8ad3-4f959d29c758 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:45.806735 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-440b8020-a970-4482-aaf6-717f3187f37d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:45.807418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-440b8020-a970-4482-aaf6-717f3187f37d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:45.814883 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-440b8020-a970-4482-aaf6-717f3187f37d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:45.815421 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-440b8020-a970-4482-aaf6-717f3187f37d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:45.816264 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-440b8020-a970-4482-aaf6-717f3187f37d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:45.816770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-440b8020-a970-4482-aaf6-717f3187f37d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:45.871481 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-10a47183-16ce-4138-8ad3-4f959d29c758 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:45.882886 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-10a47183-16ce-4138-8ad3-4f959d29c758 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.173290 Jul 19 20:49:45.883397 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 42/97] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:45 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:45.956559 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-440b8020-a970-4482-aaf6-717f3187f37d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:45.964262 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-440b8020-a970-4482-aaf6-717f3187f37d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.161652 Jul 19 20:49:45.964832 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 56/98] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:45 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:46.049959 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b494b091-1e10-45a4-8b38-975a7640dafa tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:46.050591 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b494b091-1e10-45a4-8b38-975a7640dafa tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:46.056644 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b494b091-1e10-45a4-8b38-975a7640dafa tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:46.057092 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b494b091-1e10-45a4-8b38-975a7640dafa tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:46.057914 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b494b091-1e10-45a4-8b38-975a7640dafa tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:46.058355 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b494b091-1e10-45a4-8b38-975a7640dafa tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:46.070901 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-91e9fc75-c9c8-48c7-861a-9b792f280805 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:46.071518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-91e9fc75-c9c8-48c7-861a-9b792f280805 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:46.077795 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-91e9fc75-c9c8-48c7-861a-9b792f280805 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:46.078239 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-91e9fc75-c9c8-48c7-861a-9b792f280805 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:46.079009 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-91e9fc75-c9c8-48c7-861a-9b792f280805 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:46.079953 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-91e9fc75-c9c8-48c7-861a-9b792f280805 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:46.264755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b494b091-1e10-45a4-8b38-975a7640dafa tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:46.268743 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-91e9fc75-c9c8-48c7-861a-9b792f280805 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:46.270980 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=100 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:46.272576 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b494b091-1e10-45a4-8b38-975a7640dafa tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.226459 Jul 19 20:49:46.273215 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 43/99] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:46 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:46.278217 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-91e9fc75-c9c8-48c7-861a-9b792f280805 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:46.279721 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-91e9fc75-c9c8-48c7-861a-9b792f280805 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:46.280824 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-91e9fc75-c9c8-48c7-861a-9b792f280805 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.213944 Jul 19 20:49:46.281392 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 57/100] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:46 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:49:46.900698 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-967b6d3f-d35d-4d10-95ec-bd132723fe68 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:46.901330 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-967b6d3f-d35d-4d10-95ec-bd132723fe68 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:46.908264 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-967b6d3f-d35d-4d10-95ec-bd132723fe68 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:46.908715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-967b6d3f-d35d-4d10-95ec-bd132723fe68 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:46.909517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-967b6d3f-d35d-4d10-95ec-bd132723fe68 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:46.909957 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-967b6d3f-d35d-4d10-95ec-bd132723fe68 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:46.981670 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ecef422d-c84d-48d2-9f2e-884e0202272c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:46.982278 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ecef422d-c84d-48d2-9f2e-884e0202272c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:46.988828 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ecef422d-c84d-48d2-9f2e-884e0202272c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:46.989278 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ecef422d-c84d-48d2-9f2e-884e0202272c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:46.990188 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ecef422d-c84d-48d2-9f2e-884e0202272c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:46.990631 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ecef422d-c84d-48d2-9f2e-884e0202272c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:47.081875 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-967b6d3f-d35d-4d10-95ec-bd132723fe68 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:47.091462 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-967b6d3f-d35d-4d10-95ec-bd132723fe68 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.194679 Jul 19 20:49:47.092487 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 44/101] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:46 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:47.143916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ecef422d-c84d-48d2-9f2e-884e0202272c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:47.151461 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ecef422d-c84d-48d2-9f2e-884e0202272c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.173699 Jul 19 20:49:47.152026 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 58/102] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:46 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:47.289460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f1a1b945-344f-43e1-a89f-06edcf1dbff2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:47.289983 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f1a1b945-344f-43e1-a89f-06edcf1dbff2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:47.296208 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1a1b945-344f-43e1-a89f-06edcf1dbff2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:47.296658 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1a1b945-344f-43e1-a89f-06edcf1dbff2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:47.297477 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1a1b945-344f-43e1-a89f-06edcf1dbff2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:47.299192 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-924694a8-670c-4800-974e-82f286bb9a5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:47.299482 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1a1b945-344f-43e1-a89f-06edcf1dbff2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:47.299747 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-924694a8-670c-4800-974e-82f286bb9a5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:47.305847 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-924694a8-670c-4800-974e-82f286bb9a5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:47.306287 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-924694a8-670c-4800-974e-82f286bb9a5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:47.307045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-924694a8-670c-4800-974e-82f286bb9a5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:47.307568 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-924694a8-670c-4800-974e-82f286bb9a5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:47.315309 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=100 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:47.498447 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f1a1b945-344f-43e1-a89f-06edcf1dbff2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:47.502204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-924694a8-670c-4800-974e-82f286bb9a5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:47.507580 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f1a1b945-344f-43e1-a89f-06edcf1dbff2 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.222060 Jul 19 20:49:47.508174 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 45/103] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:47 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:47.512286 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-924694a8-670c-4800-974e-82f286bb9a5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:47.513865 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-924694a8-670c-4800-974e-82f286bb9a5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:47.515072 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-924694a8-670c-4800-974e-82f286bb9a5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.220522 Jul 19 20:49:47.515938 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 59/104] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:47 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:49:47.992952 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-c7b1a362-bfb8-45f2-ab3b-226d4d8cf684 req-da34aca6-bb19-4650-bf2c-3cf0759872c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07400b5-bd6a-4841-a97c-3c7e6704de6a", "name": "network-vif-plugged", "status": "completed", "tag": "1fd8ecd1-9064-4baf-96ff-c66e1f84b6b5"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:48.004917 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-c7b1a362-bfb8-45f2-ab3b-226d4d8cf684 req-da34aca6-bb19-4650-bf2c-3cf0759872c5 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:48.005385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-c7b1a362-bfb8-45f2-ab3b-226d4d8cf684 req-da34aca6-bb19-4650-bf2c-3cf0759872c5 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:48.025646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-c7b1a362-bfb8-45f2-ab3b-226d4d8cf684 req-da34aca6-bb19-4650-bf2c-3cf0759872c5 service nova] Creating event network-vif-plugged:1fd8ecd1-9064-4baf-96ff-c66e1f84b6b5 for instance b07400b5-bd6a-4841-a97c-3c7e6704de6a on hv-cinder-79987 Jul 19 20:49:48.026414 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-c7b1a362-bfb8-45f2-ab3b-226d4d8cf684 req-da34aca6-bb19-4650-bf2c-3cf0759872c5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129867) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 20:49:48.027502 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-27faa212-18e7-40db-8d93-a69669e633ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:48.027936 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-27faa212-18e7-40db-8d93-a69669e633ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:48.028706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-27faa212-18e7-40db-8d93-a69669e633ab None None] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:48.029136 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-27faa212-18e7-40db-8d93-a69669e633ab None None] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:48.039495 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.compute.rpcapi [None req-27faa212-18e7-40db-8d93-a69669e633ab None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 20:49:48.040375 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-27faa212-18e7-40db-8d93-a69669e633ab None None] Releasing lock "compute-rpcapi-router" {{(pid=129867) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 20:49:48.057073 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-27faa212-18e7-40db-8d93-a69669e633ab None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067944 Jul 19 20:49:48.057713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 46/105] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:48.110530 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-36321340-1342-464b-bd59-87c37353a162 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:48.111135 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-36321340-1342-464b-bd59-87c37353a162 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:48.117157 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-36321340-1342-464b-bd59-87c37353a162 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:48.117642 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-36321340-1342-464b-bd59-87c37353a162 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:48.118418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-36321340-1342-464b-bd59-87c37353a162 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:48.118858 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-36321340-1342-464b-bd59-87c37353a162 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:48.169068 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-90d40103-578a-41e1-99c1-eaa5dc79e758 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:48.169854 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-90d40103-578a-41e1-99c1-eaa5dc79e758 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:48.176066 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-90d40103-578a-41e1-99c1-eaa5dc79e758 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:48.176514 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-90d40103-578a-41e1-99c1-eaa5dc79e758 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:48.177266 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-90d40103-578a-41e1-99c1-eaa5dc79e758 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:48.177845 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-90d40103-578a-41e1-99c1-eaa5dc79e758 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:48.287878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-36321340-1342-464b-bd59-87c37353a162 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:48.295571 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-36321340-1342-464b-bd59-87c37353a162 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.189179 Jul 19 20:49:48.296149 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 60/106] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:48 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:48.334637 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-90d40103-578a-41e1-99c1-eaa5dc79e758 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:48.341918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-90d40103-578a-41e1-99c1-eaa5dc79e758 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.177148 Jul 19 20:49:48.342484 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 47/107] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:48 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:48.524902 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-657345fa-993d-4679-8c6b-9b856dce88cf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:48.525564 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-657345fa-993d-4679-8c6b-9b856dce88cf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:48.531978 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-657345fa-993d-4679-8c6b-9b856dce88cf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:48.532334 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-657345fa-993d-4679-8c6b-9b856dce88cf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:48.533101 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-657345fa-993d-4679-8c6b-9b856dce88cf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:48.533479 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-40a2fa30-5763-4690-9248-9e24c0b541d9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:48.533598 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-657345fa-993d-4679-8c6b-9b856dce88cf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:48.534082 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-40a2fa30-5763-4690-9248-9e24c0b541d9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:48.540814 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-40a2fa30-5763-4690-9248-9e24c0b541d9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:48.541265 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-40a2fa30-5763-4690-9248-9e24c0b541d9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:48.542053 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-40a2fa30-5763-4690-9248-9e24c0b541d9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:48.542489 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-40a2fa30-5763-4690-9248-9e24c0b541d9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:48.786874 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-657345fa-993d-4679-8c6b-9b856dce88cf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:48.797477 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-657345fa-993d-4679-8c6b-9b856dce88cf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.276378 Jul 19 20:49:48.801055 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 61/108] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:48 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:48.820230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-40a2fa30-5763-4690-9248-9e24c0b541d9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:48.844505 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-40a2fa30-5763-4690-9248-9e24c0b541d9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:48.847451 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-40a2fa30-5763-4690-9248-9e24c0b541d9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:48.848796 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-40a2fa30-5763-4690-9248-9e24c0b541d9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.319156 Jul 19 20:49:48.863061 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 48/109] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:48 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:49:49.312412 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dcc0cc65-20c9-426b-8ad1-e23a7cfc993a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:49.313133 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-dcc0cc65-20c9-426b-8ad1-e23a7cfc993a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:49.324610 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc65-20c9-426b-8ad1-e23a7cfc993a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:49.325801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc65-20c9-426b-8ad1-e23a7cfc993a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:49.327810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc65-20c9-426b-8ad1-e23a7cfc993a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:49.331299 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dcc0cc65-20c9-426b-8ad1-e23a7cfc993a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:49.358955 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d650091f-22de-46cd-9d49-620e161b16d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:49.359806 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d650091f-22de-46cd-9d49-620e161b16d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:49.370593 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d650091f-22de-46cd-9d49-620e161b16d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:49.371510 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d650091f-22de-46cd-9d49-620e161b16d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:49.372481 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d650091f-22de-46cd-9d49-620e161b16d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:49.382522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d650091f-22de-46cd-9d49-620e161b16d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:49.554407 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dcc0cc65-20c9-426b-8ad1-e23a7cfc993a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:49.564615 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dcc0cc65-20c9-426b-8ad1-e23a7cfc993a tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.255647 Jul 19 20:49:49.566527 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 62/110] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:49 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:49.569007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d650091f-22de-46cd-9d49-620e161b16d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:49.577449 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d650091f-22de-46cd-9d49-620e161b16d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.222308 Jul 19 20:49:49.577964 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 49/111] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:49 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:49.817545 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5c7216dc-4ab8-4c5f-8751-65a4e4a44e8a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:49.818418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5c7216dc-4ab8-4c5f-8751-65a4e4a44e8a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:49.832229 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5c7216dc-4ab8-4c5f-8751-65a4e4a44e8a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:49.833478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5c7216dc-4ab8-4c5f-8751-65a4e4a44e8a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:49.834608 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5c7216dc-4ab8-4c5f-8751-65a4e4a44e8a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:49.835715 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5c7216dc-4ab8-4c5f-8751-65a4e4a44e8a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:49.880596 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fb49b3b8-9238-486b-8e98-bc2b10271f4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:49.881893 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-fb49b3b8-9238-486b-8e98-bc2b10271f4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:49.890963 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fb49b3b8-9238-486b-8e98-bc2b10271f4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:49.891630 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fb49b3b8-9238-486b-8e98-bc2b10271f4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:49.892861 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fb49b3b8-9238-486b-8e98-bc2b10271f4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:49.893550 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fb49b3b8-9238-486b-8e98-bc2b10271f4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:50.122723 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5c7216dc-4ab8-4c5f-8751-65a4e4a44e8a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:50.134264 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5c7216dc-4ab8-4c5f-8751-65a4e4a44e8a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.321959 Jul 19 20:49:50.144922 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 63/112] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:49 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:50.152816 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-fb49b3b8-9238-486b-8e98-bc2b10271f4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:50.165333 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-3a060980-0aa2-47d3-b8ac-7162ed49ded8 req-bce9a841-8533-4445-b4a6-f96063a7223d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e43f46e-319f-4ec4-8d5a-0e95995dc370", "tag": "8f0876b6-27aa-4999-81eb-a3e576f37753"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:50.166982 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-fb49b3b8-9238-486b-8e98-bc2b10271f4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:50.170950 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-fb49b3b8-9238-486b-8e98-bc2b10271f4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:50.176163 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fb49b3b8-9238-486b-8e98-bc2b10271f4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.311501 Jul 19 20:49:50.187187 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 50/113] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:49 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:49:50.190986 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-3a060980-0aa2-47d3-b8ac-7162ed49ded8 req-bce9a841-8533-4445-b4a6-f96063a7223d service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:50.191732 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-3a060980-0aa2-47d3-b8ac-7162ed49ded8 req-bce9a841-8533-4445-b4a6-f96063a7223d service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:50.206650 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-3a060980-0aa2-47d3-b8ac-7162ed49ded8 req-bce9a841-8533-4445-b4a6-f96063a7223d service nova] Creating event network-changed:8f0876b6-27aa-4999-81eb-a3e576f37753 for instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 on hv-cinder-79987 Jul 19 20:49:50.213754 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-3a060980-0aa2-47d3-b8ac-7162ed49ded8 req-bce9a841-8533-4445-b4a6-f96063a7223d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066867 Jul 19 20:49:50.214344 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 64/114] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:50.582396 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c13d26c7-becc-4a78-babe-d5d0cd37b6c7 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:50.583039 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c13d26c7-becc-4a78-babe-d5d0cd37b6c7 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:50.589200 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c13d26c7-becc-4a78-babe-d5d0cd37b6c7 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:50.589685 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c13d26c7-becc-4a78-babe-d5d0cd37b6c7 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:50.590448 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c13d26c7-becc-4a78-babe-d5d0cd37b6c7 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:50.590890 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c13d26c7-becc-4a78-babe-d5d0cd37b6c7 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:50.594536 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-486d802a-e0ca-4384-9125-7cb644544b6c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:50.595317 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-486d802a-e0ca-4384-9125-7cb644544b6c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:50.604410 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-486d802a-e0ca-4384-9125-7cb644544b6c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:50.604867 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-486d802a-e0ca-4384-9125-7cb644544b6c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:50.606058 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-486d802a-e0ca-4384-9125-7cb644544b6c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:50.606504 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-486d802a-e0ca-4384-9125-7cb644544b6c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:50.795100 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c13d26c7-becc-4a78-babe-d5d0cd37b6c7 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:50.803550 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c13d26c7-becc-4a78-babe-d5d0cd37b6c7 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.225614 Jul 19 20:49:50.804466 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 51/115] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:50 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:50.817923 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-486d802a-e0ca-4384-9125-7cb644544b6c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:50.825699 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-486d802a-e0ca-4384-9125-7cb644544b6c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.235864 Jul 19 20:49:50.826449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 65/116] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:50 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:51.151786 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4fd0019f-8d83-41da-8e84-522c50a738bd tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:51.152356 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4fd0019f-8d83-41da-8e84-522c50a738bd tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:51.159046 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4fd0019f-8d83-41da-8e84-522c50a738bd tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:51.159500 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4fd0019f-8d83-41da-8e84-522c50a738bd tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:51.160284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4fd0019f-8d83-41da-8e84-522c50a738bd tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:51.160723 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4fd0019f-8d83-41da-8e84-522c50a738bd tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:51.194846 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3528caea-f9f8-4275-ba40-c54a2bd08b2b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:51.195461 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3528caea-f9f8-4275-ba40-c54a2bd08b2b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:51.202007 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3528caea-f9f8-4275-ba40-c54a2bd08b2b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:51.202460 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3528caea-f9f8-4275-ba40-c54a2bd08b2b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:51.203281 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3528caea-f9f8-4275-ba40-c54a2bd08b2b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:51.203726 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3528caea-f9f8-4275-ba40-c54a2bd08b2b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:51.347830 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4fd0019f-8d83-41da-8e84-522c50a738bd tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:51.354982 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4fd0019f-8d83-41da-8e84-522c50a738bd tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.207142 Jul 19 20:49:51.355593 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 52/117] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:51 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:51.373904 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3528caea-f9f8-4275-ba40-c54a2bd08b2b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:51.383002 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3528caea-f9f8-4275-ba40-c54a2bd08b2b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:51.384520 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3528caea-f9f8-4275-ba40-c54a2bd08b2b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:51.385781 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3528caea-f9f8-4275-ba40-c54a2bd08b2b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.195102 Jul 19 20:49:51.386377 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 66/118] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:51 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:49:51.820810 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-26304337-fffb-477b-aac4-c23b8ed59b9d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:51.821334 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-26304337-fffb-477b-aac4-c23b8ed59b9d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:51.827463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-26304337-fffb-477b-aac4-c23b8ed59b9d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:51.827912 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-26304337-fffb-477b-aac4-c23b8ed59b9d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:51.828675 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-26304337-fffb-477b-aac4-c23b8ed59b9d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:51.829801 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-26304337-fffb-477b-aac4-c23b8ed59b9d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:51.843246 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-14b7c953-daa6-4624-b48e-623a334a529b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:51.843972 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-14b7c953-daa6-4624-b48e-623a334a529b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:51.849942 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-14b7c953-daa6-4624-b48e-623a334a529b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:51.850388 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-14b7c953-daa6-4624-b48e-623a334a529b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:51.851138 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-14b7c953-daa6-4624-b48e-623a334a529b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:51.851572 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-14b7c953-daa6-4624-b48e-623a334a529b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:52.032637 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-26304337-fffb-477b-aac4-c23b8ed59b9d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:52.042134 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-26304337-fffb-477b-aac4-c23b8ed59b9d tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.225180 Jul 19 20:49:52.042939 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 53/119] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:51 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:52.045823 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-14b7c953-daa6-4624-b48e-623a334a529b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:52.054258 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-14b7c953-daa6-4624-b48e-623a334a529b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.214970 Jul 19 20:49:52.055171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 67/120] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:51 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:52.232393 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-72b9cc0b-b58a-4bf2-b9ea-4b187cf19de2 req-76dbb025-ae59-4f8d-82cf-3769153940a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3a1c24-8f18-49bb-9bbf-711a808f4ea6", "tag": "8c146d65-9129-430d-bf2e-1d764005f0fe"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:52.241161 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-72b9cc0b-b58a-4bf2-b9ea-4b187cf19de2 req-76dbb025-ae59-4f8d-82cf-3769153940a7 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:52.241638 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-72b9cc0b-b58a-4bf2-b9ea-4b187cf19de2 req-76dbb025-ae59-4f8d-82cf-3769153940a7 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:52.253271 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-72b9cc0b-b58a-4bf2-b9ea-4b187cf19de2 req-76dbb025-ae59-4f8d-82cf-3769153940a7 service nova] Creating event network-changed:8c146d65-9129-430d-bf2e-1d764005f0fe for instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 on hv-cinder-79987 Jul 19 20:49:52.258146 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-72b9cc0b-b58a-4bf2-b9ea-4b187cf19de2 req-76dbb025-ae59-4f8d-82cf-3769153940a7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029405 Jul 19 20:49:52.258767 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 54/121] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:49:52.372201 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3e578085-d455-443e-8599-5cedca8d2f49 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:52.372797 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3e578085-d455-443e-8599-5cedca8d2f49 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:52.379694 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3e578085-d455-443e-8599-5cedca8d2f49 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:52.380210 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3e578085-d455-443e-8599-5cedca8d2f49 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:52.380962 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3e578085-d455-443e-8599-5cedca8d2f49 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:52.381420 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3e578085-d455-443e-8599-5cedca8d2f49 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:52.404077 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0cc8d6c3-5973-4232-8692-606d0c162314 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:52.404763 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0cc8d6c3-5973-4232-8692-606d0c162314 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:52.410952 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0cc8d6c3-5973-4232-8692-606d0c162314 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:52.411396 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0cc8d6c3-5973-4232-8692-606d0c162314 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:52.412344 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0cc8d6c3-5973-4232-8692-606d0c162314 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:52.412626 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0cc8d6c3-5973-4232-8692-606d0c162314 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:52.568736 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3e578085-d455-443e-8599-5cedca8d2f49 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:52.576128 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3e578085-d455-443e-8599-5cedca8d2f49 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.207773 Jul 19 20:49:52.576699 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 68/122] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:52 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:52.589870 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0cc8d6c3-5973-4232-8692-606d0c162314 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:52.599076 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0cc8d6c3-5973-4232-8692-606d0c162314 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:52.601322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0cc8d6c3-5973-4232-8692-606d0c162314 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:52.602490 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0cc8d6c3-5973-4232-8692-606d0c162314 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.202636 Jul 19 20:49:52.603050 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 55/123] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:52 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:49:53.059240 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-08540e08-cf49-4c5b-9092-8b6be9e4f066 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:53.060128 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-08540e08-cf49-4c5b-9092-8b6be9e4f066 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:53.066398 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-08540e08-cf49-4c5b-9092-8b6be9e4f066 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:53.066988 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-08540e08-cf49-4c5b-9092-8b6be9e4f066 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:53.067920 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-08540e08-cf49-4c5b-9092-8b6be9e4f066 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:53.068470 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-08540e08-cf49-4c5b-9092-8b6be9e4f066 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:53.071726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f11013a2-4206-493c-acf7-c0d39668fa9d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:53.072337 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f11013a2-4206-493c-acf7-c0d39668fa9d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:53.080260 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f11013a2-4206-493c-acf7-c0d39668fa9d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:53.080744 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f11013a2-4206-493c-acf7-c0d39668fa9d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:53.081533 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f11013a2-4206-493c-acf7-c0d39668fa9d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:53.082089 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f11013a2-4206-493c-acf7-c0d39668fa9d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:53.308225 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-08540e08-cf49-4c5b-9092-8b6be9e4f066 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:53.318571 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-08540e08-cf49-4c5b-9092-8b6be9e4f066 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.263196 Jul 19 20:49:53.323872 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 69/124] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:53 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:53.342514 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f11013a2-4206-493c-acf7-c0d39668fa9d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:53.353717 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f11013a2-4206-493c-acf7-c0d39668fa9d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.286025 Jul 19 20:49:53.354592 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 56/125] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:53 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:53.593502 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-08413a0d-7e7c-4f9b-8522-f202739c619b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:53.594115 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-08413a0d-7e7c-4f9b-8522-f202739c619b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:53.600233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-08413a0d-7e7c-4f9b-8522-f202739c619b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:53.600687 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-08413a0d-7e7c-4f9b-8522-f202739c619b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:53.601530 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-08413a0d-7e7c-4f9b-8522-f202739c619b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:53.602567 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-08413a0d-7e7c-4f9b-8522-f202739c619b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:53.620403 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-87e7456b-88c5-47d5-8b4f-5b2d85f66b51 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:53.621018 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-87e7456b-88c5-47d5-8b4f-5b2d85f66b51 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:53.627829 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-87e7456b-88c5-47d5-8b4f-5b2d85f66b51 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:53.628286 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-87e7456b-88c5-47d5-8b4f-5b2d85f66b51 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:53.629053 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-87e7456b-88c5-47d5-8b4f-5b2d85f66b51 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:53.629527 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-87e7456b-88c5-47d5-8b4f-5b2d85f66b51 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:53.805669 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-08413a0d-7e7c-4f9b-8522-f202739c619b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:53.817333 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-08413a0d-7e7c-4f9b-8522-f202739c619b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.227866 Jul 19 20:49:53.818553 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 70/126] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:53 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:53.842419 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-87e7456b-88c5-47d5-8b4f-5b2d85f66b51 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:53.852872 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-87e7456b-88c5-47d5-8b4f-5b2d85f66b51 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:53.854418 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-87e7456b-88c5-47d5-8b4f-5b2d85f66b51 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:53.855531 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-87e7456b-88c5-47d5-8b4f-5b2d85f66b51 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.239314 Jul 19 20:49:53.856564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 57/127] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:53 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:49:54.343292 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-92e2aea5-c1a9-4f1d-b179-2f633440b888 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:54.343888 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-92e2aea5-c1a9-4f1d-b179-2f633440b888 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:54.352315 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-92e2aea5-c1a9-4f1d-b179-2f633440b888 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:54.353287 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-92e2aea5-c1a9-4f1d-b179-2f633440b888 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:54.354104 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-92e2aea5-c1a9-4f1d-b179-2f633440b888 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:54.354594 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-92e2aea5-c1a9-4f1d-b179-2f633440b888 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:54.371935 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-6d6fd178-1c0e-4677-bfb4-5c023ea5b617 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:54.372558 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-6d6fd178-1c0e-4677-bfb4-5c023ea5b617 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:54.381981 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6d6fd178-1c0e-4677-bfb4-5c023ea5b617 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:54.382763 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6d6fd178-1c0e-4677-bfb4-5c023ea5b617 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:54.383355 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6d6fd178-1c0e-4677-bfb4-5c023ea5b617 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:54.383790 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6d6fd178-1c0e-4677-bfb4-5c023ea5b617 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:54.657655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-92e2aea5-c1a9-4f1d-b179-2f633440b888 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:54.668732 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-92e2aea5-c1a9-4f1d-b179-2f633440b888 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1315 microversion: 2.1 time: 0.330572 Jul 19 20:49:54.678534 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 71/128] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:54 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:54.690620 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6d6fd178-1c0e-4677-bfb4-5c023ea5b617 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:54.700396 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-6d6fd178-1c0e-4677-bfb4-5c023ea5b617 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.332868 Jul 19 20:49:54.702578 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 58/129] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:54 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:54.789050 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-64ad337a-b85e-4ad5-91fa-cd32267c6193 req-8211271e-9f35-403f-b5c4-96baa8087486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84348ad4-6efa-4243-b5af-b5d6994c316b", "name": "network-vif-plugged", "status": "completed", "tag": "7fd29114-ce93-4e34-847f-1dce713d7bb5"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:54.803469 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-64ad337a-b85e-4ad5-91fa-cd32267c6193 req-8211271e-9f35-403f-b5c4-96baa8087486 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:54.804223 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-64ad337a-b85e-4ad5-91fa-cd32267c6193 req-8211271e-9f35-403f-b5c4-96baa8087486 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:54.819372 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-64ad337a-b85e-4ad5-91fa-cd32267c6193 req-8211271e-9f35-403f-b5c4-96baa8087486 service nova] Creating event network-vif-plugged:7fd29114-ce93-4e34-847f-1dce713d7bb5 for instance 84348ad4-6efa-4243-b5af-b5d6994c316b on hv-cinder-79987 Jul 19 20:49:54.826551 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-64ad337a-b85e-4ad5-91fa-cd32267c6193 req-8211271e-9f35-403f-b5c4-96baa8087486 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045010 Jul 19 20:49:54.835830 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-dee5b1a7-7c66-409c-8508-5ea901f125ba tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:54.837397 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-dee5b1a7-7c66-409c-8508-5ea901f125ba tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:54.842305 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 72/130] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:49:54.847514 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dee5b1a7-7c66-409c-8508-5ea901f125ba tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:54.848237 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dee5b1a7-7c66-409c-8508-5ea901f125ba tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:54.849440 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dee5b1a7-7c66-409c-8508-5ea901f125ba tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:54.851405 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dee5b1a7-7c66-409c-8508-5ea901f125ba tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:54.885647 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-990be8a8-fdb9-40f5-9144-f6d7dd7ab015 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:54.886528 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-990be8a8-fdb9-40f5-9144-f6d7dd7ab015 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:54.900140 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-990be8a8-fdb9-40f5-9144-f6d7dd7ab015 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:54.901114 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-990be8a8-fdb9-40f5-9144-f6d7dd7ab015 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:54.903569 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-990be8a8-fdb9-40f5-9144-f6d7dd7ab015 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:54.904672 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-990be8a8-fdb9-40f5-9144-f6d7dd7ab015 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:55.227627 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-990be8a8-fdb9-40f5-9144-f6d7dd7ab015 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:55.240159 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-990be8a8-fdb9-40f5-9144-f6d7dd7ab015 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:55.245294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-990be8a8-fdb9-40f5-9144-f6d7dd7ab015 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:55.247010 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-990be8a8-fdb9-40f5-9144-f6d7dd7ab015 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.367425 Jul 19 20:49:55.254671 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 73/131] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:54 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:49:55.266041 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-dee5b1a7-7c66-409c-8508-5ea901f125ba tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:55.276400 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-dee5b1a7-7c66-409c-8508-5ea901f125ba tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.445396 Jul 19 20:49:55.277154 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 59/132] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:54 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:55.686100 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e4711c37-2361-48b7-9cd4-e254ee7d7eda tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:55.686814 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e4711c37-2361-48b7-9cd4-e254ee7d7eda tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:55.694330 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e4711c37-2361-48b7-9cd4-e254ee7d7eda tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:55.695058 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e4711c37-2361-48b7-9cd4-e254ee7d7eda tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:55.696234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e4711c37-2361-48b7-9cd4-e254ee7d7eda tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:55.696859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e4711c37-2361-48b7-9cd4-e254ee7d7eda tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:55.726362 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-91906e13-55de-4c16-b7bd-91dfb72c6eec tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:55.730458 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-91906e13-55de-4c16-b7bd-91dfb72c6eec tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:55.744444 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-91906e13-55de-4c16-b7bd-91dfb72c6eec tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:55.746185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-91906e13-55de-4c16-b7bd-91dfb72c6eec tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:55.747592 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-91906e13-55de-4c16-b7bd-91dfb72c6eec tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:55.748660 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-91906e13-55de-4c16-b7bd-91dfb72c6eec tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:55.901587 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e4711c37-2361-48b7-9cd4-e254ee7d7eda tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:55.913869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e4711c37-2361-48b7-9cd4-e254ee7d7eda tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1502 microversion: 2.1 time: 0.230679 Jul 19 20:49:55.914472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 74/133] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:55 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:55.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-91906e13-55de-4c16-b7bd-91dfb72c6eec tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:55.990404 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-91906e13-55de-4c16-b7bd-91dfb72c6eec tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.274959 Jul 19 20:49:55.991734 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 60/134] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:55 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:56.267674 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ea191f2c-3bc7-4769-84d6-b54067c60cab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:56.267990 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ea191f2c-3bc7-4769-84d6-b54067c60cab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:56.285287 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ea191f2c-3bc7-4769-84d6-b54067c60cab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:56.285984 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ea191f2c-3bc7-4769-84d6-b54067c60cab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:56.290059 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ea191f2c-3bc7-4769-84d6-b54067c60cab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:56.290992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ea191f2c-3bc7-4769-84d6-b54067c60cab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:56.294762 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2d05b8c3-e96a-4fc5-92df-0838eee94b5e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:56.295910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2d05b8c3-e96a-4fc5-92df-0838eee94b5e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:56.313033 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d05b8c3-e96a-4fc5-92df-0838eee94b5e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:56.314095 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d05b8c3-e96a-4fc5-92df-0838eee94b5e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:56.314908 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d05b8c3-e96a-4fc5-92df-0838eee94b5e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:56.318574 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d05b8c3-e96a-4fc5-92df-0838eee94b5e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:56.612976 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ea191f2c-3bc7-4769-84d6-b54067c60cab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:56.617815 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=100 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:56.626981 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2d05b8c3-e96a-4fc5-92df-0838eee94b5e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:56.627412 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ea191f2c-3bc7-4769-84d6-b54067c60cab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:56.629282 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ea191f2c-3bc7-4769-84d6-b54067c60cab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:56.630690 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ea191f2c-3bc7-4769-84d6-b54067c60cab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.368392 Jul 19 20:49:56.631763 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 75/135] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:56 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:49:56.634801 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2d05b8c3-e96a-4fc5-92df-0838eee94b5e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.344669 Jul 19 20:49:56.643869 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 61/136] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:56 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:57.008384 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-617dc410-a4c7-4489-802f-d748c90911fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:57.009205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-617dc410-a4c7-4489-802f-d748c90911fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:57.022471 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-617dc410-a4c7-4489-802f-d748c90911fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:57.022987 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-617dc410-a4c7-4489-802f-d748c90911fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:57.025114 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-617dc410-a4c7-4489-802f-d748c90911fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:57.026480 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-617dc410-a4c7-4489-802f-d748c90911fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:57.197283 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-617dc410-a4c7-4489-802f-d748c90911fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:57.205933 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-617dc410-a4c7-4489-802f-d748c90911fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1321 microversion: 2.1 time: 0.201977 Jul 19 20:49:57.206830 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 76/137] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:57 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:57.513675 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f6e0e333-88e6-4531-a925-610656a1e41b tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "155e8966-03c2-45d8-8ea6-a3698e1ab5b4"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:57.515994 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f6e0e333-88e6-4531-a925-610656a1e41b tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:57.524992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f6e0e333-88e6-4531-a925-610656a1e41b tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:57.525660 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f6e0e333-88e6-4531-a925-610656a1e41b tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:57.526655 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f6e0e333-88e6-4531-a925-610656a1e41b tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:57.543207 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f6e0e333-88e6-4531-a925-610656a1e41b tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:57.648586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9fd8d55c-73b8-42e9-bbd9-e78866fd8ad8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:57.649339 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-9fd8d55c-73b8-42e9-bbd9-e78866fd8ad8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:57.659077 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fd8d55c-73b8-42e9-bbd9-e78866fd8ad8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:57.660695 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fd8d55c-73b8-42e9-bbd9-e78866fd8ad8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:57.663252 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fd8d55c-73b8-42e9-bbd9-e78866fd8ad8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:57.664213 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fd8d55c-73b8-42e9-bbd9-e78866fd8ad8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:57.945755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9fd8d55c-73b8-42e9-bbd9-e78866fd8ad8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:57.954635 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9fd8d55c-73b8-42e9-bbd9-e78866fd8ad8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:57.956322 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9fd8d55c-73b8-42e9-bbd9-e78866fd8ad8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:57.957472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9fd8d55c-73b8-42e9-bbd9-e78866fd8ad8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.313082 Jul 19 20:49:57.958232 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 77/138] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:57 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:49:57.963061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-156ca2f2-9589-42a1-8fc3-8928e9358c66 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:57.963786 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-156ca2f2-9589-42a1-8fc3-8928e9358c66 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:57.971292 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-156ca2f2-9589-42a1-8fc3-8928e9358c66 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:57.971851 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-156ca2f2-9589-42a1-8fc3-8928e9358c66 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:57.972647 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-156ca2f2-9589-42a1-8fc3-8928e9358c66 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:57.973083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-156ca2f2-9589-42a1-8fc3-8928e9358c66 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:58.037882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:58.163792 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-156ca2f2-9589-42a1-8fc3-8928e9358c66 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:58.173519 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-156ca2f2-9589-42a1-8fc3-8928e9358c66 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.213468 Jul 19 20:49:58.183030 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 78/139] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:57 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:58.224506 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-13b43c8e-6d1d-43ae-8e37-ec0effc07003 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:58.225479 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-13b43c8e-6d1d-43ae-8e37-ec0effc07003 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:58.232169 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-13b43c8e-6d1d-43ae-8e37-ec0effc07003 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:58.232763 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-13b43c8e-6d1d-43ae-8e37-ec0effc07003 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:58.233580 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-13b43c8e-6d1d-43ae-8e37-ec0effc07003 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:58.234023 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-13b43c8e-6d1d-43ae-8e37-ec0effc07003 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:58.402945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-13b43c8e-6d1d-43ae-8e37-ec0effc07003 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:58.411926 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-13b43c8e-6d1d-43ae-8e37-ec0effc07003 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1515 microversion: 2.1 time: 0.192127 Jul 19 20:49:58.413079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 79/140] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:58 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:49:58.431175 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-07e4bb4c-65bc-4fed-b4ad-755ea89e219d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:49:58.432685 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-07e4bb4c-65bc-4fed-b4ad-755ea89e219d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:58.443452 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-07e4bb4c-65bc-4fed-b4ad-755ea89e219d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:58.444165 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-07e4bb4c-65bc-4fed-b4ad-755ea89e219d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:58.445246 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-07e4bb4c-65bc-4fed-b4ad-755ea89e219d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:58.446017 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-07e4bb4c-65bc-4fed-b4ad-755ea89e219d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:58.513352 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-07e4bb4c-65bc-4fed-b4ad-755ea89e219d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lazy-loading 'flavor' on Instance uuid 84348ad4-6efa-4243-b5af-b5d6994c316b {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:49:58.647893 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-07e4bb4c-65bc-4fed-b4ad-755ea89e219d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "POST /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b/action" status: 200 len: 32 microversion: 2.1 time: 0.222104 Jul 19 20:49:58.648955 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 80/141] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 20:49:58 2022] POST /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:49:58.659375 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c41b3383-427f-4167-8630-c07cff5ca903 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:58.660082 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c41b3383-427f-4167-8630-c07cff5ca903 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:58.666295 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c41b3383-427f-4167-8630-c07cff5ca903 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:58.666747 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c41b3383-427f-4167-8630-c07cff5ca903 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:58.667516 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c41b3383-427f-4167-8630-c07cff5ca903 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:58.667952 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c41b3383-427f-4167-8630-c07cff5ca903 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:59.076255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c41b3383-427f-4167-8630-c07cff5ca903 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:59.094109 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c41b3383-427f-4167-8630-c07cff5ca903 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.438797 Jul 19 20:49:59.094855 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 81/142] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:58 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:49:59.103772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9822d4d8-e9c7-4625-ab51-efcf16c039b4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:59.108795 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-9822d4d8-e9c7-4625-ab51-efcf16c039b4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:59.116748 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9822d4d8-e9c7-4625-ab51-efcf16c039b4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:59.117065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9822d4d8-e9c7-4625-ab51-efcf16c039b4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:59.118148 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9822d4d8-e9c7-4625-ab51-efcf16c039b4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:59.118583 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9822d4d8-e9c7-4625-ab51-efcf16c039b4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:59.289399 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9822d4d8-e9c7-4625-ab51-efcf16c039b4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:59.302723 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9822d4d8-e9c7-4625-ab51-efcf16c039b4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:59.304590 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9822d4d8-e9c7-4625-ab51-efcf16c039b4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:59.307613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9822d4d8-e9c7-4625-ab51-efcf16c039b4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.206779 Jul 19 20:49:59.308277 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 82/143] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:49:59 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:49:59.325342 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4e62aa55-988b-4043-8891-52bd1b4f95f6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:49:59.326182 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4e62aa55-988b-4043-8891-52bd1b4f95f6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:49:59.336419 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4e62aa55-988b-4043-8891-52bd1b4f95f6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:59.337081 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4e62aa55-988b-4043-8891-52bd1b4f95f6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:59.338778 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4e62aa55-988b-4043-8891-52bd1b4f95f6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:49:59.339442 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4e62aa55-988b-4043-8891-52bd1b4f95f6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:49:59.515861 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4e62aa55-988b-4043-8891-52bd1b4f95f6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:49:59.528680 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4e62aa55-988b-4043-8891-52bd1b4f95f6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.205091 Jul 19 20:49:59.528680 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 83/144] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:49:59 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:00.112058 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b9c416aa-3b28-4e3b-869c-baf47c850e6e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:00.112799 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b9c416aa-3b28-4e3b-869c-baf47c850e6e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:00.120309 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b9c416aa-3b28-4e3b-869c-baf47c850e6e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:00.121191 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b9c416aa-3b28-4e3b-869c-baf47c850e6e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:00.122292 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b9c416aa-3b28-4e3b-869c-baf47c850e6e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:00.122869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b9c416aa-3b28-4e3b-869c-baf47c850e6e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:00.307667 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b9c416aa-3b28-4e3b-869c-baf47c850e6e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:00.322231 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b9c416aa-3b28-4e3b-869c-baf47c850e6e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.213163 Jul 19 20:50:00.323433 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 84/145] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:00 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:00.328283 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-68fe8484-1fdd-4c92-9e38-005e32354577 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:00.329004 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-68fe8484-1fdd-4c92-9e38-005e32354577 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:00.335513 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-68fe8484-1fdd-4c92-9e38-005e32354577 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:00.335966 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-68fe8484-1fdd-4c92-9e38-005e32354577 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:00.337000 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-68fe8484-1fdd-4c92-9e38-005e32354577 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:00.337466 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-68fe8484-1fdd-4c92-9e38-005e32354577 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:00.505419 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-68fe8484-1fdd-4c92-9e38-005e32354577 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:00.514694 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-68fe8484-1fdd-4c92-9e38-005e32354577 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:00.518340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-68fe8484-1fdd-4c92-9e38-005e32354577 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:00.520388 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-68fe8484-1fdd-4c92-9e38-005e32354577 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.195452 Jul 19 20:50:00.521122 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 85/146] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:00 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:50:00.549975 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b46bef37-72d3-4683-b956-3a638d6cf294 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:00.551081 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b46bef37-72d3-4683-b956-3a638d6cf294 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:00.559785 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b46bef37-72d3-4683-b956-3a638d6cf294 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:00.560437 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b46bef37-72d3-4683-b956-3a638d6cf294 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:00.561499 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b46bef37-72d3-4683-b956-3a638d6cf294 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:00.562083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b46bef37-72d3-4683-b956-3a638d6cf294 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:00.607858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=100 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:00.876355 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b46bef37-72d3-4683-b956-3a638d6cf294 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:00.888148 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b46bef37-72d3-4683-b956-3a638d6cf294 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.348814 Jul 19 20:50:00.899676 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 86/147] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:00 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:01.117068 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f6e0e333-88e6-4531-a925-610656a1e41b tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "POST /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.606965 Jul 19 20:50:01.121437 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 62/148] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 20:49:57 2022] POST /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b/os-volume_attachments => generated 194 bytes in 3612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:01.340144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3c2b86dd-1c00-475c-9cd5-1c386aa23816 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:01.340761 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3c2b86dd-1c00-475c-9cd5-1c386aa23816 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:01.356344 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3c2b86dd-1c00-475c-9cd5-1c386aa23816 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:01.357827 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3c2b86dd-1c00-475c-9cd5-1c386aa23816 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:01.363292 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3c2b86dd-1c00-475c-9cd5-1c386aa23816 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:01.364191 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3c2b86dd-1c00-475c-9cd5-1c386aa23816 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:01.541120 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-1ffa151f-c474-41f4-a2ab-245d3b857437 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:01.541871 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-1ffa151f-c474-41f4-a2ab-245d3b857437 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:01.553162 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1ffa151f-c474-41f4-a2ab-245d3b857437 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:01.561704 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1ffa151f-c474-41f4-a2ab-245d3b857437 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:01.567534 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1ffa151f-c474-41f4-a2ab-245d3b857437 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:01.571602 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1ffa151f-c474-41f4-a2ab-245d3b857437 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:01.678087 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3c2b86dd-1c00-475c-9cd5-1c386aa23816 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:01.687520 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3c2b86dd-1c00-475c-9cd5-1c386aa23816 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.351372 Jul 19 20:50:01.688106 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 87/149] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:01 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:01.886221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1ffa151f-c474-41f4-a2ab-245d3b857437 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:01.899457 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1ffa151f-c474-41f4-a2ab-245d3b857437 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:01.901409 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1ffa151f-c474-41f4-a2ab-245d3b857437 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:01.907207 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-163a0911-d17f-4b91-b8e7-57ac97ee9c96 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:01.908296 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-163a0911-d17f-4b91-b8e7-57ac97ee9c96 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:01.912775 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-1ffa151f-c474-41f4-a2ab-245d3b857437 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.375975 Jul 19 20:50:01.916345 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 63/150] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:01 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:50:01.917728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-163a0911-d17f-4b91-b8e7-57ac97ee9c96 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:01.918403 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-163a0911-d17f-4b91-b8e7-57ac97ee9c96 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:01.919817 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-163a0911-d17f-4b91-b8e7-57ac97ee9c96 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:01.920369 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-163a0911-d17f-4b91-b8e7-57ac97ee9c96 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:02.179452 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-163a0911-d17f-4b91-b8e7-57ac97ee9c96 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:02.190131 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-163a0911-d17f-4b91-b8e7-57ac97ee9c96 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.285915 Jul 19 20:50:02.191254 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 88/151] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:01 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:02.706815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-69f9af39-4aad-4cf1-bdd8-6207c358b38f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:02.707576 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-69f9af39-4aad-4cf1-bdd8-6207c358b38f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:02.722594 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-69f9af39-4aad-4cf1-bdd8-6207c358b38f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:02.724227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-69f9af39-4aad-4cf1-bdd8-6207c358b38f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:02.725607 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-69f9af39-4aad-4cf1-bdd8-6207c358b38f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:02.726079 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-69f9af39-4aad-4cf1-bdd8-6207c358b38f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:02.770689 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-28d9fe9b-a671-43ce-91b9-f9afce88b491 req-11517c16-32a3-4f5b-895e-d8214d7b8e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3a1c24-8f18-49bb-9bbf-711a808f4ea6", "name": "network-vif-plugged", "status": "completed", "tag": "8c146d65-9129-430d-bf2e-1d764005f0fe"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:02.774624 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=100 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:02.785096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-28d9fe9b-a671-43ce-91b9-f9afce88b491 req-11517c16-32a3-4f5b-895e-d8214d7b8e8d service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:02.790035 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-28d9fe9b-a671-43ce-91b9-f9afce88b491 req-11517c16-32a3-4f5b-895e-d8214d7b8e8d service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:02.810098 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-28d9fe9b-a671-43ce-91b9-f9afce88b491 req-11517c16-32a3-4f5b-895e-d8214d7b8e8d service nova] Creating event network-vif-plugged:8c146d65-9129-430d-bf2e-1d764005f0fe for instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 on hv-cinder-79987 Jul 19 20:50:02.815709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-28d9fe9b-a671-43ce-91b9-f9afce88b491 req-11517c16-32a3-4f5b-895e-d8214d7b8e8d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050312 Jul 19 20:50:02.816957 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 89/152] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:50:02.937902 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-80bd9aa0-e5fe-4b3e-9908-76bfa7f788a2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:02.939401 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-80bd9aa0-e5fe-4b3e-9908-76bfa7f788a2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:02.949350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-80bd9aa0-e5fe-4b3e-9908-76bfa7f788a2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:02.950193 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-80bd9aa0-e5fe-4b3e-9908-76bfa7f788a2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:02.952291 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-80bd9aa0-e5fe-4b3e-9908-76bfa7f788a2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:02.954055 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-80bd9aa0-e5fe-4b3e-9908-76bfa7f788a2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:03.033455 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-69f9af39-4aad-4cf1-bdd8-6207c358b38f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:03.044778 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-69f9af39-4aad-4cf1-bdd8-6207c358b38f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.340326 Jul 19 20:50:03.044778 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 64/153] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:02 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:03.189696 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-80bd9aa0-e5fe-4b3e-9908-76bfa7f788a2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:03.204875 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-80bd9aa0-e5fe-4b3e-9908-76bfa7f788a2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:03.207760 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-80bd9aa0-e5fe-4b3e-9908-76bfa7f788a2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:03.207926 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-974563d4-8942-4525-970a-1dc922639acc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:03.208501 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-974563d4-8942-4525-970a-1dc922639acc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:03.209666 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-80bd9aa0-e5fe-4b3e-9908-76bfa7f788a2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.276180 Jul 19 20:50:03.210934 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 90/154] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:02 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:50:03.218444 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-974563d4-8942-4525-970a-1dc922639acc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:03.218902 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-974563d4-8942-4525-970a-1dc922639acc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:03.220221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-974563d4-8942-4525-970a-1dc922639acc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:03.220662 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-974563d4-8942-4525-970a-1dc922639acc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:03.495614 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-974563d4-8942-4525-970a-1dc922639acc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:03.521327 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-974563d4-8942-4525-970a-1dc922639acc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.317247 Jul 19 20:50:03.525015 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 65/155] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:03 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:04.066146 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a3ff05e0-d482-4625-8e19-ed8749238046 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:04.066982 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a3ff05e0-d482-4625-8e19-ed8749238046 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:04.077204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a3ff05e0-d482-4625-8e19-ed8749238046 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:04.083105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a3ff05e0-d482-4625-8e19-ed8749238046 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:04.084254 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a3ff05e0-d482-4625-8e19-ed8749238046 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:04.086025 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a3ff05e0-d482-4625-8e19-ed8749238046 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:04.096422 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:04.230476 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0e3f7ee6-f3a9-47d6-9ddf-cde054432498 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:04.232199 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0e3f7ee6-f3a9-47d6-9ddf-cde054432498 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:04.242522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0e3f7ee6-f3a9-47d6-9ddf-cde054432498 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:04.243467 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0e3f7ee6-f3a9-47d6-9ddf-cde054432498 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:04.244510 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0e3f7ee6-f3a9-47d6-9ddf-cde054432498 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:04.245102 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0e3f7ee6-f3a9-47d6-9ddf-cde054432498 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:04.275399 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-a3ff05e0-d482-4625-8e19-ed8749238046 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:04.284556 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a3ff05e0-d482-4625-8e19-ed8749238046 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.228332 Jul 19 20:50:04.286630 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 91/156] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:04 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:04.424096 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0e3f7ee6-f3a9-47d6-9ddf-cde054432498 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:04.441672 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0e3f7ee6-f3a9-47d6-9ddf-cde054432498 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:04.443569 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0e3f7ee6-f3a9-47d6-9ddf-cde054432498 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:04.444810 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0e3f7ee6-f3a9-47d6-9ddf-cde054432498 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.218175 Jul 19 20:50:04.455047 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 66/157] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:04 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:50:04.546481 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-205c35f8-0e22-4066-9245-8a06d1c229cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:04.549169 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-205c35f8-0e22-4066-9245-8a06d1c229cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:04.570047 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-205c35f8-0e22-4066-9245-8a06d1c229cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:04.570408 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-205c35f8-0e22-4066-9245-8a06d1c229cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:04.571239 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-205c35f8-0e22-4066-9245-8a06d1c229cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:04.571673 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-205c35f8-0e22-4066-9245-8a06d1c229cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:04.786599 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-205c35f8-0e22-4066-9245-8a06d1c229cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:04.803436 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-205c35f8-0e22-4066-9245-8a06d1c229cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.264415 Jul 19 20:50:04.803996 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 92/158] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:04 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:05.302868 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b5d93bf0-7951-4f16-a572-e8e434e8b0eb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:05.303613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b5d93bf0-7951-4f16-a572-e8e434e8b0eb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:05.311341 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5d93bf0-7951-4f16-a572-e8e434e8b0eb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:05.311908 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5d93bf0-7951-4f16-a572-e8e434e8b0eb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:05.312823 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5d93bf0-7951-4f16-a572-e8e434e8b0eb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:05.314113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5d93bf0-7951-4f16-a572-e8e434e8b0eb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:05.467224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4fd3681a-0f88-4051-aa4b-495d0be14f9e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:05.469034 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4fd3681a-0f88-4051-aa4b-495d0be14f9e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:05.486439 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4fd3681a-0f88-4051-aa4b-495d0be14f9e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:05.487395 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4fd3681a-0f88-4051-aa4b-495d0be14f9e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:05.489885 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4fd3681a-0f88-4051-aa4b-495d0be14f9e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:05.491090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4fd3681a-0f88-4051-aa4b-495d0be14f9e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:05.549739 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b5d93bf0-7951-4f16-a572-e8e434e8b0eb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:05.560070 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b5d93bf0-7951-4f16-a572-e8e434e8b0eb tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.261039 Jul 19 20:50:05.563632 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 67/159] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:05 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:05.759482 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4fd3681a-0f88-4051-aa4b-495d0be14f9e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:05.769738 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4fd3681a-0f88-4051-aa4b-495d0be14f9e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:05.771247 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4fd3681a-0f88-4051-aa4b-495d0be14f9e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:05.772363 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4fd3681a-0f88-4051-aa4b-495d0be14f9e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.311614 Jul 19 20:50:05.773088 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 93/160] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:05 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:50:05.820734 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2364f77a-cb39-440a-b387-e6f0ccb1d1a3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:05.821558 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2364f77a-cb39-440a-b387-e6f0ccb1d1a3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:05.824073 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=79 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:05.830263 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2364f77a-cb39-440a-b387-e6f0ccb1d1a3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:05.830733 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2364f77a-cb39-440a-b387-e6f0ccb1d1a3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:05.831504 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2364f77a-cb39-440a-b387-e6f0ccb1d1a3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:05.831995 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2364f77a-cb39-440a-b387-e6f0ccb1d1a3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:06.026680 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2364f77a-cb39-440a-b387-e6f0ccb1d1a3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:06.035505 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2364f77a-cb39-440a-b387-e6f0ccb1d1a3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.219218 Jul 19 20:50:06.036533 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 68/161] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:05 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:06.588883 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5fa62c65-6434-41d8-9886-de5b44216eaa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:06.590603 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5fa62c65-6434-41d8-9886-de5b44216eaa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:06.610728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5fa62c65-6434-41d8-9886-de5b44216eaa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:06.610728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5fa62c65-6434-41d8-9886-de5b44216eaa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:06.610728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5fa62c65-6434-41d8-9886-de5b44216eaa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:06.610728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5fa62c65-6434-41d8-9886-de5b44216eaa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:06.757943 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5fa62c65-6434-41d8-9886-de5b44216eaa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:06.765903 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5fa62c65-6434-41d8-9886-de5b44216eaa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.183007 Jul 19 20:50:06.769712 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 94/162] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:06 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:06.791968 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b4bd2061-d314-4890-b86c-72c8fe20cf15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:06.793202 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b4bd2061-d314-4890-b86c-72c8fe20cf15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:06.801763 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b4bd2061-d314-4890-b86c-72c8fe20cf15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:06.802351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b4bd2061-d314-4890-b86c-72c8fe20cf15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:06.803200 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b4bd2061-d314-4890-b86c-72c8fe20cf15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:06.803714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b4bd2061-d314-4890-b86c-72c8fe20cf15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:06.995387 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b4bd2061-d314-4890-b86c-72c8fe20cf15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:07.006819 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b4bd2061-d314-4890-b86c-72c8fe20cf15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:07.009131 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b4bd2061-d314-4890-b86c-72c8fe20cf15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:07.010451 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b4bd2061-d314-4890-b86c-72c8fe20cf15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.223198 Jul 19 20:50:07.021500 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 69/163] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:06 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:50:07.052919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e6f05c1b-9a30-41d0-9217-c8176d4dc0b9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:07.053485 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e6f05c1b-9a30-41d0-9217-c8176d4dc0b9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:07.060444 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e6f05c1b-9a30-41d0-9217-c8176d4dc0b9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:07.060980 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e6f05c1b-9a30-41d0-9217-c8176d4dc0b9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:07.061983 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e6f05c1b-9a30-41d0-9217-c8176d4dc0b9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:07.062572 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e6f05c1b-9a30-41d0-9217-c8176d4dc0b9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:07.226912 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e6f05c1b-9a30-41d0-9217-c8176d4dc0b9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:07.237280 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e6f05c1b-9a30-41d0-9217-c8176d4dc0b9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.188127 Jul 19 20:50:07.237999 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 95/164] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:07 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:07.784640 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f433cea0-8fff-473a-ac04-f21e286a949d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:07.785724 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f433cea0-8fff-473a-ac04-f21e286a949d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:07.794511 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f433cea0-8fff-473a-ac04-f21e286a949d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:07.795944 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f433cea0-8fff-473a-ac04-f21e286a949d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:07.797190 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f433cea0-8fff-473a-ac04-f21e286a949d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:07.798391 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f433cea0-8fff-473a-ac04-f21e286a949d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:07.956694 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f433cea0-8fff-473a-ac04-f21e286a949d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:07.964568 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f433cea0-8fff-473a-ac04-f21e286a949d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.184282 Jul 19 20:50:07.965155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 70/165] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:07 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:08.035980 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-eb263aaa-af64-4d46-afe2-5c1c0136ae99 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:08.037020 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-eb263aaa-af64-4d46-afe2-5c1c0136ae99 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:08.045715 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-eb263aaa-af64-4d46-afe2-5c1c0136ae99 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:08.046163 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-eb263aaa-af64-4d46-afe2-5c1c0136ae99 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:08.047225 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-eb263aaa-af64-4d46-afe2-5c1c0136ae99 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:08.047803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-eb263aaa-af64-4d46-afe2-5c1c0136ae99 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:08.222295 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-eb263aaa-af64-4d46-afe2-5c1c0136ae99 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:08.233348 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-eb263aaa-af64-4d46-afe2-5c1c0136ae99 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:08.235486 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-eb263aaa-af64-4d46-afe2-5c1c0136ae99 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:08.236600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-eb263aaa-af64-4d46-afe2-5c1c0136ae99 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.205906 Jul 19 20:50:08.237158 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 96/166] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:08 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:50:08.255004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c2e1b32f-a31f-4418-ba7c-1a91e4d16d70 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:08.255697 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c2e1b32f-a31f-4418-ba7c-1a91e4d16d70 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:08.262001 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c2e1b32f-a31f-4418-ba7c-1a91e4d16d70 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:08.262414 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c2e1b32f-a31f-4418-ba7c-1a91e4d16d70 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:08.263172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c2e1b32f-a31f-4418-ba7c-1a91e4d16d70 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:08.263599 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c2e1b32f-a31f-4418-ba7c-1a91e4d16d70 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:08.438716 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c2e1b32f-a31f-4418-ba7c-1a91e4d16d70 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:08.446788 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c2e1b32f-a31f-4418-ba7c-1a91e4d16d70 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.195680 Jul 19 20:50:08.447570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 71/167] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:08 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:08.983799 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9d8a7109-7844-4584-95d1-50f7a442657e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:08.984396 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-9d8a7109-7844-4584-95d1-50f7a442657e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:08.992607 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9d8a7109-7844-4584-95d1-50f7a442657e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:08.993050 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9d8a7109-7844-4584-95d1-50f7a442657e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:08.994039 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9d8a7109-7844-4584-95d1-50f7a442657e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:08.994740 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9d8a7109-7844-4584-95d1-50f7a442657e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:09.152086 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9d8a7109-7844-4584-95d1-50f7a442657e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:09.164360 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9d8a7109-7844-4584-95d1-50f7a442657e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.185232 Jul 19 20:50:09.164946 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 97/168] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:08 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:09.256661 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f4d796fb-6944-42a2-821d-e6a9b53b85cd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:09.258294 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f4d796fb-6944-42a2-821d-e6a9b53b85cd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:09.265076 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f4d796fb-6944-42a2-821d-e6a9b53b85cd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:09.265696 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f4d796fb-6944-42a2-821d-e6a9b53b85cd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:09.267075 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f4d796fb-6944-42a2-821d-e6a9b53b85cd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:09.267685 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f4d796fb-6944-42a2-821d-e6a9b53b85cd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:09.404906 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f4d796fb-6944-42a2-821d-e6a9b53b85cd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:09.413620 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f4d796fb-6944-42a2-821d-e6a9b53b85cd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:09.415337 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f4d796fb-6944-42a2-821d-e6a9b53b85cd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:09.416483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f4d796fb-6944-42a2-821d-e6a9b53b85cd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.163940 Jul 19 20:50:09.417049 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 72/169] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:09 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:50:09.464355 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5c2a88fc-9c1b-452b-b692-22fc8b4921da tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:09.465235 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5c2a88fc-9c1b-452b-b692-22fc8b4921da tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:09.471584 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5c2a88fc-9c1b-452b-b692-22fc8b4921da tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:09.472041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5c2a88fc-9c1b-452b-b692-22fc8b4921da tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:09.472801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5c2a88fc-9c1b-452b-b692-22fc8b4921da tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:09.473235 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5c2a88fc-9c1b-452b-b692-22fc8b4921da tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:09.609560 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5c2a88fc-9c1b-452b-b692-22fc8b4921da tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:09.617692 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5c2a88fc-9c1b-452b-b692-22fc8b4921da tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.157386 Jul 19 20:50:09.618261 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 98/170] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:09 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:10.182698 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4fe3454b-49da-445b-88de-82c7b245c8b3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:10.183667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4fe3454b-49da-445b-88de-82c7b245c8b3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:10.190972 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4fe3454b-49da-445b-88de-82c7b245c8b3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:10.191417 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4fe3454b-49da-445b-88de-82c7b245c8b3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:10.192411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4fe3454b-49da-445b-88de-82c7b245c8b3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:10.192858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4fe3454b-49da-445b-88de-82c7b245c8b3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:10.349635 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4fe3454b-49da-445b-88de-82c7b245c8b3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:10.357261 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4fe3454b-49da-445b-88de-82c7b245c8b3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.179899 Jul 19 20:50:10.357875 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 73/171] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:10 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:10.435729 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-153e2126-a52a-4cc5-af72-59f8e27e1dab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:10.436333 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-153e2126-a52a-4cc5-af72-59f8e27e1dab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:10.443176 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-153e2126-a52a-4cc5-af72-59f8e27e1dab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:10.443915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-153e2126-a52a-4cc5-af72-59f8e27e1dab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:10.444555 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-153e2126-a52a-4cc5-af72-59f8e27e1dab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:10.444971 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-153e2126-a52a-4cc5-af72-59f8e27e1dab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:10.634693 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d4553e13-23d1-446f-bc99-4226d006e23e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:10.635302 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d4553e13-23d1-446f-bc99-4226d006e23e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:10.641241 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d4553e13-23d1-446f-bc99-4226d006e23e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:10.641761 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d4553e13-23d1-446f-bc99-4226d006e23e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:10.642515 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d4553e13-23d1-446f-bc99-4226d006e23e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:10.642953 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d4553e13-23d1-446f-bc99-4226d006e23e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:10.660381 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-153e2126-a52a-4cc5-af72-59f8e27e1dab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:10.670306 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-153e2126-a52a-4cc5-af72-59f8e27e1dab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:10.672077 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-153e2126-a52a-4cc5-af72-59f8e27e1dab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:10.673487 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-153e2126-a52a-4cc5-af72-59f8e27e1dab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.241715 Jul 19 20:50:10.674805 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 99/172] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:10 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:50:10.820722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d4553e13-23d1-446f-bc99-4226d006e23e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:10.828183 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d4553e13-23d1-446f-bc99-4226d006e23e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.197452 Jul 19 20:50:10.828783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 74/173] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:10 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:11.381463 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e59b7d5b-203d-41ea-a3f0-341281e413f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:11.382973 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e59b7d5b-203d-41ea-a3f0-341281e413f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:11.390559 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e59b7d5b-203d-41ea-a3f0-341281e413f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:11.394008 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e59b7d5b-203d-41ea-a3f0-341281e413f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:11.394848 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e59b7d5b-203d-41ea-a3f0-341281e413f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:11.395291 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e59b7d5b-203d-41ea-a3f0-341281e413f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:11.567651 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e59b7d5b-203d-41ea-a3f0-341281e413f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:11.580650 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e59b7d5b-203d-41ea-a3f0-341281e413f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.204907 Jul 19 20:50:11.581693 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 100/174] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:11 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:11.699094 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-505d8c75-2ae2-468f-ba7e-77a10dc18e01 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:11.700285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-505d8c75-2ae2-468f-ba7e-77a10dc18e01 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:11.711681 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-505d8c75-2ae2-468f-ba7e-77a10dc18e01 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:11.712377 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-505d8c75-2ae2-468f-ba7e-77a10dc18e01 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:11.713300 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-505d8c75-2ae2-468f-ba7e-77a10dc18e01 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:11.713872 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-505d8c75-2ae2-468f-ba7e-77a10dc18e01 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:11.845851 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a1d1e852-7410-4329-b6f7-99b07db8dd6c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:11.846464 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a1d1e852-7410-4329-b6f7-99b07db8dd6c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:11.854920 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a1d1e852-7410-4329-b6f7-99b07db8dd6c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:11.854920 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a1d1e852-7410-4329-b6f7-99b07db8dd6c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:11.856037 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a1d1e852-7410-4329-b6f7-99b07db8dd6c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:11.856130 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a1d1e852-7410-4329-b6f7-99b07db8dd6c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:12.046028 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-505d8c75-2ae2-468f-ba7e-77a10dc18e01 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:12.062655 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-505d8c75-2ae2-468f-ba7e-77a10dc18e01 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:12.066839 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-505d8c75-2ae2-468f-ba7e-77a10dc18e01 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:12.068945 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-505d8c75-2ae2-468f-ba7e-77a10dc18e01 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.375916 Jul 19 20:50:12.069908 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 75/175] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:11 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:50:12.075831 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-89e0ffba-f205-4866-af05-3039c6b2103b req-d6226f5d-6c27-4eff-980b-9cad92740cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e43f46e-319f-4ec4-8d5a-0e95995dc370", "name": "network-vif-plugged", "status": "completed", "tag": "8f0876b6-27aa-4999-81eb-a3e576f37753"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:12.091951 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-89e0ffba-f205-4866-af05-3039c6b2103b req-d6226f5d-6c27-4eff-980b-9cad92740cc6 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:12.093726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-89e0ffba-f205-4866-af05-3039c6b2103b req-d6226f5d-6c27-4eff-980b-9cad92740cc6 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:12.111450 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-89e0ffba-f205-4866-af05-3039c6b2103b req-d6226f5d-6c27-4eff-980b-9cad92740cc6 service nova] Creating event network-vif-plugged:8f0876b6-27aa-4999-81eb-a3e576f37753 for instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 on hv-cinder-79987 Jul 19 20:50:12.120392 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-89e0ffba-f205-4866-af05-3039c6b2103b req-d6226f5d-6c27-4eff-980b-9cad92740cc6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048850 Jul 19 20:50:12.121862 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 76/176] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:12.194968 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-a1d1e852-7410-4329-b6f7-99b07db8dd6c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:12.205270 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a1d1e852-7410-4329-b6f7-99b07db8dd6c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1367 microversion: 2.1 time: 0.363442 Jul 19 20:50:12.206220 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 101/177] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:11 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:12.600233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b50b9dc5-f7e5-4410-857e-2e7f4e799fe5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:12.601523 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b50b9dc5-f7e5-4410-857e-2e7f4e799fe5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:12.609783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b50b9dc5-f7e5-4410-857e-2e7f4e799fe5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:12.610705 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b50b9dc5-f7e5-4410-857e-2e7f4e799fe5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:12.611643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b50b9dc5-f7e5-4410-857e-2e7f4e799fe5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:12.612162 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b50b9dc5-f7e5-4410-857e-2e7f4e799fe5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:12.824061 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b50b9dc5-f7e5-4410-857e-2e7f4e799fe5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:12.832771 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b50b9dc5-f7e5-4410-857e-2e7f4e799fe5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.238503 Jul 19 20:50:12.833660 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 77/178] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:12 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:13.089481 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-92616060-530d-471d-b060-20ba65af7ae2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:13.090504 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-92616060-530d-471d-b060-20ba65af7ae2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:13.097966 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-92616060-530d-471d-b060-20ba65af7ae2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:13.098465 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-92616060-530d-471d-b060-20ba65af7ae2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:13.099233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-92616060-530d-471d-b060-20ba65af7ae2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:13.099660 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-92616060-530d-471d-b060-20ba65af7ae2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:13.224833 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-91d8cefd-38c5-400b-8899-e9834accef67 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:13.226521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-91d8cefd-38c5-400b-8899-e9834accef67 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:13.233809 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-91d8cefd-38c5-400b-8899-e9834accef67 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:13.234342 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-91d8cefd-38c5-400b-8899-e9834accef67 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:13.235214 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-91d8cefd-38c5-400b-8899-e9834accef67 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:13.235888 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-91d8cefd-38c5-400b-8899-e9834accef67 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:13.269164 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-92616060-530d-471d-b060-20ba65af7ae2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:13.291082 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-92616060-530d-471d-b060-20ba65af7ae2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:13.294751 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-92616060-530d-471d-b060-20ba65af7ae2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:13.296308 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-92616060-530d-471d-b060-20ba65af7ae2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.212068 Jul 19 20:50:13.297143 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 102/179] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:13 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:50:13.440600 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-91d8cefd-38c5-400b-8899-e9834accef67 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:13.452384 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-91d8cefd-38c5-400b-8899-e9834accef67 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1558 microversion: 2.1 time: 0.232661 Jul 19 20:50:13.453466 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 78/180] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:13 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1558 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:13.475357 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9fe55e35-4c4a-43f8-b7ec-efd26def278f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:13.476036 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-9fe55e35-4c4a-43f8-b7ec-efd26def278f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:13.486084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fe55e35-4c4a-43f8-b7ec-efd26def278f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:13.488092 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fe55e35-4c4a-43f8-b7ec-efd26def278f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:13.489695 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fe55e35-4c4a-43f8-b7ec-efd26def278f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:13.490443 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fe55e35-4c4a-43f8-b7ec-efd26def278f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:13.630632 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9fe55e35-4c4a-43f8-b7ec-efd26def278f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162642 Jul 19 20:50:13.633325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 103/181] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jul 19 20:50:13 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:13.854691 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f40ff44f-51f1-4950-8dd8-1e54586f5869 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:13.855299 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f40ff44f-51f1-4950-8dd8-1e54586f5869 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:13.863006 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f40ff44f-51f1-4950-8dd8-1e54586f5869 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:13.863778 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f40ff44f-51f1-4950-8dd8-1e54586f5869 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:13.864709 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f40ff44f-51f1-4950-8dd8-1e54586f5869 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:13.865286 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f40ff44f-51f1-4950-8dd8-1e54586f5869 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:13.868622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:14.150796 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f40ff44f-51f1-4950-8dd8-1e54586f5869 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:14.163119 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f40ff44f-51f1-4950-8dd8-1e54586f5869 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.312592 Jul 19 20:50:14.164004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 79/182] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:13 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:14.314767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-891f2446-3426-45e7-9269-0b8f1d636c6a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:14.315917 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-891f2446-3426-45e7-9269-0b8f1d636c6a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:14.327261 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-891f2446-3426-45e7-9269-0b8f1d636c6a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:14.327261 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-891f2446-3426-45e7-9269-0b8f1d636c6a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:14.329531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-891f2446-3426-45e7-9269-0b8f1d636c6a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:14.330023 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-891f2446-3426-45e7-9269-0b8f1d636c6a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:14.612294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-891f2446-3426-45e7-9269-0b8f1d636c6a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:14.628952 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-891f2446-3426-45e7-9269-0b8f1d636c6a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:14.631149 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-891f2446-3426-45e7-9269-0b8f1d636c6a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:14.635010 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-891f2446-3426-45e7-9269-0b8f1d636c6a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.321836 Jul 19 20:50:14.635621 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 104/183] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:14 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:50:15.184933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-299c9ac3-e118-4f17-8625-7e8749fb32e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:15.186207 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-299c9ac3-e118-4f17-8625-7e8749fb32e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:15.197586 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-299c9ac3-e118-4f17-8625-7e8749fb32e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:15.199920 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-299c9ac3-e118-4f17-8625-7e8749fb32e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:15.201022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-299c9ac3-e118-4f17-8625-7e8749fb32e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:15.203035 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-299c9ac3-e118-4f17-8625-7e8749fb32e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:15.342220 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-44f66550-c102-486e-bef9-8d0efe9ca186 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:15.342768 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-44f66550-c102-486e-bef9-8d0efe9ca186 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:15.351764 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-44f66550-c102-486e-bef9-8d0efe9ca186 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:15.352262 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-44f66550-c102-486e-bef9-8d0efe9ca186 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:15.352988 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-44f66550-c102-486e-bef9-8d0efe9ca186 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:15.353469 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-44f66550-c102-486e-bef9-8d0efe9ca186 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:15.382214 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-44f66550-c102-486e-bef9-8d0efe9ca186 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Going to try to terminate instance {{(pid=129866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:50:15.544539 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-44f66550-c102-486e-bef9-8d0efe9ca186 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "DELETE /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 204 len: 0 microversion: 2.1 time: 0.205935 Jul 19 20:50:15.555531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 105/184] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:50:15 2022] DELETE /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:50:15.574945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8e65657f-f6cd-4a13-ba17-06a8ed942add tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:15.576279 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8e65657f-f6cd-4a13-ba17-06a8ed942add tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:15.585227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-299c9ac3-e118-4f17-8625-7e8749fb32e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:15.589533 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8e65657f-f6cd-4a13-ba17-06a8ed942add tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:15.596547 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8e65657f-f6cd-4a13-ba17-06a8ed942add tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:15.597746 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8e65657f-f6cd-4a13-ba17-06a8ed942add tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:15.598088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-299c9ac3-e118-4f17-8625-7e8749fb32e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.419489 Jul 19 20:50:15.598530 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8e65657f-f6cd-4a13-ba17-06a8ed942add tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:15.598842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 80/185] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:15 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:15.618285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-21bdb09d-7c59-42e7-ae1c-559cde168581 req-25984d76-ebc6-4da2-b6ec-8fcff765342c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3a1c24-8f18-49bb-9bbf-711a808f4ea6", "tag": "8c146d65-9129-430d-bf2e-1d764005f0fe"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:15.635586 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-21bdb09d-7c59-42e7-ae1c-559cde168581 req-25984d76-ebc6-4da2-b6ec-8fcff765342c service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:15.636416 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-21bdb09d-7c59-42e7-ae1c-559cde168581 req-25984d76-ebc6-4da2-b6ec-8fcff765342c service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:15.639548 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:15.659198 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-21bdb09d-7c59-42e7-ae1c-559cde168581 req-25984d76-ebc6-4da2-b6ec-8fcff765342c service nova] Creating event network-changed:8c146d65-9129-430d-bf2e-1d764005f0fe for instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 on hv-cinder-79987 Jul 19 20:50:15.674393 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-21bdb09d-7c59-42e7-ae1c-559cde168581 req-25984d76-ebc6-4da2-b6ec-8fcff765342c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068494 Jul 19 20:50:15.674393 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 81/186] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:15.689591 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-3c575ca4-64c1-4930-b703-620a9bab88cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:15.690588 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-3c575ca4-64c1-4930-b703-620a9bab88cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:15.711754 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3c575ca4-64c1-4930-b703-620a9bab88cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:15.712376 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3c575ca4-64c1-4930-b703-620a9bab88cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:15.715979 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3c575ca4-64c1-4930-b703-620a9bab88cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:15.716438 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3c575ca4-64c1-4930-b703-620a9bab88cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:15.947271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-8e65657f-f6cd-4a13-ba17-06a8ed942add tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:15.965681 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8e65657f-f6cd-4a13-ba17-06a8ed942add tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1554 microversion: 2.1 time: 0.405576 Jul 19 20:50:15.966352 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 106/187] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:15 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1554 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:15.987095 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3c575ca4-64c1-4930-b703-620a9bab88cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:16.007770 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3c575ca4-64c1-4930-b703-620a9bab88cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:16.011311 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3c575ca4-64c1-4930-b703-620a9bab88cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:16.012548 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-3c575ca4-64c1-4930-b703-620a9bab88cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.338039 Jul 19 20:50:16.013214 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 82/188] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:15 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:50:16.615554 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2f3b2ae4-c089-4eef-b858-f4ba6e988527 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:16.616150 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2f3b2ae4-c089-4eef-b858-f4ba6e988527 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:16.626825 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2f3b2ae4-c089-4eef-b858-f4ba6e988527 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:16.628910 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2f3b2ae4-c089-4eef-b858-f4ba6e988527 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:16.629879 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2f3b2ae4-c089-4eef-b858-f4ba6e988527 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:16.630859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2f3b2ae4-c089-4eef-b858-f4ba6e988527 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:16.937601 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2f3b2ae4-c089-4eef-b858-f4ba6e988527 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:16.946087 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2f3b2ae4-c089-4eef-b858-f4ba6e988527 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.334271 Jul 19 20:50:16.946787 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 107/189] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:16 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:16.992267 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-dac8d5e7-b360-448c-a9a3-ddb4529956d5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:16.992907 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-dac8d5e7-b360-448c-a9a3-ddb4529956d5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:17.003723 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dac8d5e7-b360-448c-a9a3-ddb4529956d5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:17.004159 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dac8d5e7-b360-448c-a9a3-ddb4529956d5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:17.004947 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dac8d5e7-b360-448c-a9a3-ddb4529956d5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:17.005424 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dac8d5e7-b360-448c-a9a3-ddb4529956d5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:17.038172 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-12017d70-f510-4ec5-9ebe-59399dbb96a1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:17.039372 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-12017d70-f510-4ec5-9ebe-59399dbb96a1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:17.055047 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12017d70-f510-4ec5-9ebe-59399dbb96a1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:17.056270 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12017d70-f510-4ec5-9ebe-59399dbb96a1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:17.057161 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12017d70-f510-4ec5-9ebe-59399dbb96a1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:17.063766 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12017d70-f510-4ec5-9ebe-59399dbb96a1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:17.332702 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-dac8d5e7-b360-448c-a9a3-ddb4529956d5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:17.348708 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-dac8d5e7-b360-448c-a9a3-ddb4529956d5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1554 microversion: 2.1 time: 0.361542 Jul 19 20:50:17.351573 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 83/190] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:16 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1554 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:17.425303 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-12017d70-f510-4ec5-9ebe-59399dbb96a1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:17.435164 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-12017d70-f510-4ec5-9ebe-59399dbb96a1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:17.437166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-12017d70-f510-4ec5-9ebe-59399dbb96a1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:17.438611 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-12017d70-f510-4ec5-9ebe-59399dbb96a1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.408403 Jul 19 20:50:17.450624 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 108/191] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:17 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:50:17.964124 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b1c50dcc-53ed-4e3f-ac00-bc3186e74c44 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:17.964998 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b1c50dcc-53ed-4e3f-ac00-bc3186e74c44 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:17.971533 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b1c50dcc-53ed-4e3f-ac00-bc3186e74c44 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:17.972249 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b1c50dcc-53ed-4e3f-ac00-bc3186e74c44 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:17.972893 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b1c50dcc-53ed-4e3f-ac00-bc3186e74c44 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:17.973326 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b1c50dcc-53ed-4e3f-ac00-bc3186e74c44 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:18.116982 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b1c50dcc-53ed-4e3f-ac00-bc3186e74c44 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:18.125041 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b1c50dcc-53ed-4e3f-ac00-bc3186e74c44 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.164902 Jul 19 20:50:18.125696 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 84/192] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:17 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:18.368238 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6ceb72b3-0f49-4f76-a4b7-95a2a0a857a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:18.368951 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6ceb72b3-0f49-4f76-a4b7-95a2a0a857a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:18.376873 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6ceb72b3-0f49-4f76-a4b7-95a2a0a857a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:18.377505 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6ceb72b3-0f49-4f76-a4b7-95a2a0a857a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:18.378522 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6ceb72b3-0f49-4f76-a4b7-95a2a0a857a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:18.379026 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6ceb72b3-0f49-4f76-a4b7-95a2a0a857a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:18.457727 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-39a2a353-fb6b-48d8-9f6f-66548c4b83f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:18.458341 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-39a2a353-fb6b-48d8-9f6f-66548c4b83f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:18.468049 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-39a2a353-fb6b-48d8-9f6f-66548c4b83f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:18.468765 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-39a2a353-fb6b-48d8-9f6f-66548c4b83f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:18.470130 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-39a2a353-fb6b-48d8-9f6f-66548c4b83f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:18.474326 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-39a2a353-fb6b-48d8-9f6f-66548c4b83f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:18.805615 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6ceb72b3-0f49-4f76-a4b7-95a2a0a857a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:18.820897 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6ceb72b3-0f49-4f76-a4b7-95a2a0a857a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1554 microversion: 2.1 time: 0.456473 Jul 19 20:50:18.821520 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 109/193] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:18 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1554 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:18.890793 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-39a2a353-fb6b-48d8-9f6f-66548c4b83f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:18.911213 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-39a2a353-fb6b-48d8-9f6f-66548c4b83f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:18.911213 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-39a2a353-fb6b-48d8-9f6f-66548c4b83f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:18.911213 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-39a2a353-fb6b-48d8-9f6f-66548c4b83f3 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1403 microversion: 2.20 time: 0.457299 Jul 19 20:50:18.913415 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 85/194] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:18 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1403 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:50:19.142258 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0e6ac53c-81fe-42e4-82c0-f80a35d7a954 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:19.142738 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0e6ac53c-81fe-42e4-82c0-f80a35d7a954 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:19.149424 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0e6ac53c-81fe-42e4-82c0-f80a35d7a954 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:19.149885 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0e6ac53c-81fe-42e4-82c0-f80a35d7a954 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:19.150660 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0e6ac53c-81fe-42e4-82c0-f80a35d7a954 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:19.151097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0e6ac53c-81fe-42e4-82c0-f80a35d7a954 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:19.366472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0e6ac53c-81fe-42e4-82c0-f80a35d7a954 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:19.390681 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0e6ac53c-81fe-42e4-82c0-f80a35d7a954 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.252347 Jul 19 20:50:19.401872 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 110/195] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:19 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:19.845484 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8d91bbca-0479-430e-9103-eca0eab76380 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:19.845484 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8d91bbca-0479-430e-9103-eca0eab76380 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:19.862386 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8d91bbca-0479-430e-9103-eca0eab76380 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:19.865285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8d91bbca-0479-430e-9103-eca0eab76380 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:19.866516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8d91bbca-0479-430e-9103-eca0eab76380 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:19.867128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8d91bbca-0479-430e-9103-eca0eab76380 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:19.948711 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e36d8518-3ff1-4571-909f-75b36ab0ab4e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:19.950338 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e36d8518-3ff1-4571-909f-75b36ab0ab4e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:19.970972 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e36d8518-3ff1-4571-909f-75b36ab0ab4e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:19.971715 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e36d8518-3ff1-4571-909f-75b36ab0ab4e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:19.977599 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e36d8518-3ff1-4571-909f-75b36ab0ab4e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:19.978139 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e36d8518-3ff1-4571-909f-75b36ab0ab4e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:20.182994 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8d91bbca-0479-430e-9103-eca0eab76380 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:20.194819 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8d91bbca-0479-430e-9103-eca0eab76380 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1554 microversion: 2.1 time: 0.359583 Jul 19 20:50:20.201318 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 86/196] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:19 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1554 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:20.251654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e36d8518-3ff1-4571-909f-75b36ab0ab4e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:20.261097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e36d8518-3ff1-4571-909f-75b36ab0ab4e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:20.262880 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e36d8518-3ff1-4571-909f-75b36ab0ab4e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:20.264136 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e36d8518-3ff1-4571-909f-75b36ab0ab4e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1595 microversion: 2.20 time: 0.337459 Jul 19 20:50:20.264936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 111/197] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:50:19 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1595 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:50:20.287241 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-986c7565-db26-4180-8f8b-9f7b0a7c436f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:20.287730 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-986c7565-db26-4180-8f8b-9f7b0a7c436f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:20.294657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-15c5980b-96db-48c9-a4f8-4881dec6e98c req-b10d21f9-f12c-4190-a1c5-4d640d803ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b03a24-f1b1-4dd1-bbe4-2e017296709b", "name": "network-vif-deleted", "tag": "a318c0fd-56e8-453b-891c-8f0d834e4c18"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:20.300764 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-986c7565-db26-4180-8f8b-9f7b0a7c436f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:20.301224 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-986c7565-db26-4180-8f8b-9f7b0a7c436f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:20.302185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-986c7565-db26-4180-8f8b-9f7b0a7c436f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:20.302808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-986c7565-db26-4180-8f8b-9f7b0a7c436f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:20.304559 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-15c5980b-96db-48c9-a4f8-4881dec6e98c req-b10d21f9-f12c-4190-a1c5-4d640d803ec2 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:20.305194 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-15c5980b-96db-48c9-a4f8-4881dec6e98c req-b10d21f9-f12c-4190-a1c5-4d640d803ec2 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:20.318680 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-15c5980b-96db-48c9-a4f8-4881dec6e98c req-b10d21f9-f12c-4190-a1c5-4d640d803ec2 service nova] Creating event network-vif-deleted:a318c0fd-56e8-453b-891c-8f0d834e4c18 for instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b on hv-cinder-79987 Jul 19 20:50:20.324587 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-15c5980b-96db-48c9-a4f8-4881dec6e98c req-b10d21f9-f12c-4190-a1c5-4d640d803ec2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033650 Jul 19 20:50:20.325459 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 112/198] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:20.410523 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-96dc1a54-98b1-49b8-bdf9-bbf3451f57cc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:20.411232 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-96dc1a54-98b1-49b8-bdf9-bbf3451f57cc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:20.425333 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-96dc1a54-98b1-49b8-bdf9-bbf3451f57cc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:20.426044 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-96dc1a54-98b1-49b8-bdf9-bbf3451f57cc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:20.426971 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-96dc1a54-98b1-49b8-bdf9-bbf3451f57cc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:20.427563 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-96dc1a54-98b1-49b8-bdf9-bbf3451f57cc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:20.434758 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-986c7565-db26-4180-8f8b-9f7b0a7c436f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151383 Jul 19 20:50:20.435395 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 87/199] 10.222.0.70 () {60 vars in 1315 bytes} [Tue Jul 19 20:50:20 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 20:50:20.600356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-96dc1a54-98b1-49b8-bdf9-bbf3451f57cc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:20.608585 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-96dc1a54-98b1-49b8-bdf9-bbf3451f57cc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.203264 Jul 19 20:50:20.609168 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 113/200] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:20 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:21.220236 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f82600f0-279f-476b-bc66-88a9114f9d03 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:21.220854 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f82600f0-279f-476b-bc66-88a9114f9d03 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:21.240745 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f82600f0-279f-476b-bc66-88a9114f9d03 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:21.241191 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f82600f0-279f-476b-bc66-88a9114f9d03 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:21.241995 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f82600f0-279f-476b-bc66-88a9114f9d03 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:21.242425 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f82600f0-279f-476b-bc66-88a9114f9d03 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:21.301196 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f82600f0-279f-476b-bc66-88a9114f9d03 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:21.302389 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f82600f0-279f-476b-bc66-88a9114f9d03 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:21.303517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-f82600f0-279f-476b-bc66-88a9114f9d03 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lazy-loading 'fault' on Instance uuid 62b03a24-f1b1-4dd1-bbe4-2e017296709b {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:50:21.407515 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f82600f0-279f-476b-bc66-88a9114f9d03 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20eed246b8e140688a628664f29e38a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efbb2e43cc74d63ad721e3971e7b181', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:21.419109 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f82600f0-279f-476b-bc66-88a9114f9d03 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 200 len: 1305 microversion: 2.1 time: 0.203496 Jul 19 20:50:21.420667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 88/201] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:21 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 1305 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:21.625915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d5f03290-a16f-4d88-b473-52113359d11e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:21.627200 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d5f03290-a16f-4d88-b473-52113359d11e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:21.633860 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d5f03290-a16f-4d88-b473-52113359d11e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:21.634514 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d5f03290-a16f-4d88-b473-52113359d11e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:21.635455 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d5f03290-a16f-4d88-b473-52113359d11e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:21.635894 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d5f03290-a16f-4d88-b473-52113359d11e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:21.866407 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d5f03290-a16f-4d88-b473-52113359d11e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:21.874494 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d5f03290-a16f-4d88-b473-52113359d11e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.252588 Jul 19 20:50:21.876246 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 114/202] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:21 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:22.341123 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-ebbafd3f-64f0-4a9c-a88e-4c3800285f53 req-f77b8c94-2ae4-4e09-8677-661aa955617f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e43f46e-319f-4ec4-8d5a-0e95995dc370", "tag": "8f0876b6-27aa-4999-81eb-a3e576f37753"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:22.351136 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-ebbafd3f-64f0-4a9c-a88e-4c3800285f53 req-f77b8c94-2ae4-4e09-8677-661aa955617f service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:22.351900 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-ebbafd3f-64f0-4a9c-a88e-4c3800285f53 req-f77b8c94-2ae4-4e09-8677-661aa955617f service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:22.378696 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-ebbafd3f-64f0-4a9c-a88e-4c3800285f53 req-f77b8c94-2ae4-4e09-8677-661aa955617f service nova] Creating event network-changed:8f0876b6-27aa-4999-81eb-a3e576f37753 for instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 on hv-cinder-79987 Jul 19 20:50:22.391164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-ebbafd3f-64f0-4a9c-a88e-4c3800285f53 req-f77b8c94-2ae4-4e09-8677-661aa955617f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053296 Jul 19 20:50:22.395987 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 89/203] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:22.448784 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-21a70392-fcf5-4002-b173-ce5cc6a6c7f2 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:22.449837 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-21a70392-fcf5-4002-b173-ce5cc6a6c7f2 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:22.463609 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-21a70392-fcf5-4002-b173-ce5cc6a6c7f2 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:22.465689 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-21a70392-fcf5-4002-b173-ce5cc6a6c7f2 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:22.466907 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-21a70392-fcf5-4002-b173-ce5cc6a6c7f2 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:22.467772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-21a70392-fcf5-4002-b173-ce5cc6a6c7f2 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:22.488678 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-21a70392-fcf5-4002-b173-ce5cc6a6c7f2 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] HTTP exception thrown: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-21a70392-fcf5-4002-b173-ce5cc6a6c7f2 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Request method failure captured: Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b HTTP/1.1 Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjCCie2K034uXKH37y61dwtswjOc7W5ZQgUvUs8nistWg2XdxBjaDT7IZ-41ESdkCHYzJmCkxLpWj__6lvQ9gOLzRcECDugAEHSs0Bsby0-Zcfq7186SYgE2aTlTeh92KyLxw1twJ9zTefk8UjFGSQnvzY3k6AyvxPCk76kcC3m_Pg Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 0efbb2e43cc74d63ad721e3971e7b181 Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-DeleteServersTestJSON-635157655 Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:50:22.495418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:50:22.496843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0efbb2e43cc74d63ad721e3971e7b181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0efbb2e43cc74d63ad721e3971e7b181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0efbb2e43cc74d63ad721e3971e7b181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0efbb2e43cc74d63ad721e3971e7b181", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:50:22.496843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-DeleteServersTestJSON-635157655 Jul 19 20:50:22.496843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 0efbb2e43cc74d63ad721e3971e7b181 Jul 19 20:50:22.496843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-DeleteServersTestJSON-635157655 Jul 19 20:50:22.496843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-DeleteServersTestJSON-635157655-project Jul 19 20:50:22.496843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:50:22.496843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:50:22.496843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: 20eed246b8e140688a628664f29e38a4 Jul 19 20:50:22.496843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-DeleteServersTestJSON-635157655-project Jul 19 20:50:22.496843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:50:22.496843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:22.496843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '62b03a24-f1b1-4dd1-bbe4-2e017296709b'} Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:50:22.497543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:22.498636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:22.502104 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-21a70392-fcf5-4002-b173-ce5cc6a6c7f2 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Returning 404 to user: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:50:22.503535 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-21a70392-fcf5-4002-b173-ce5cc6a6c7f2 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 404 len: 111 microversion: 2.1 time: 0.060474 Jul 19 20:50:22.505331 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 115/204] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:22 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:50:22.727408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9ede37f3-5710-478e-a8ea-64b36dc90ccd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:22.728471 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9ede37f3-5710-478e-a8ea-64b36dc90ccd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:22.749989 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9ede37f3-5710-478e-a8ea-64b36dc90ccd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:22.751247 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9ede37f3-5710-478e-a8ea-64b36dc90ccd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:22.752244 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9ede37f3-5710-478e-a8ea-64b36dc90ccd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:22.752998 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9ede37f3-5710-478e-a8ea-64b36dc90ccd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:22.784928 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-9ede37f3-5710-478e-a8ea-64b36dc90ccd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] HTTP exception thrown: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9ede37f3-5710-478e-a8ea-64b36dc90ccd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Request method failure captured: Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b/os-volume_attachments HTTP/1.1 Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjCCie2K034uXKH37y61dwtswjOc7W5ZQgUvUs8nistWg2XdxBjaDT7IZ-41ESdkCHYzJmCkxLpWj__6lvQ9gOLzRcECDugAEHSs0Bsby0-Zcfq7186SYgE2aTlTeh92KyLxw1twJ9zTefk8UjFGSQnvzY3k6AyvxPCk76kcC3m_Pg Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 0efbb2e43cc74d63ad721e3971e7b181 Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-DeleteServersTestJSON-635157655 Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:50:22.801603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:50:22.803083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0efbb2e43cc74d63ad721e3971e7b181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0efbb2e43cc74d63ad721e3971e7b181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0efbb2e43cc74d63ad721e3971e7b181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0efbb2e43cc74d63ad721e3971e7b181", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:50:22.803083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-DeleteServersTestJSON-635157655 Jul 19 20:50:22.803083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 0efbb2e43cc74d63ad721e3971e7b181 Jul 19 20:50:22.803083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-DeleteServersTestJSON-635157655 Jul 19 20:50:22.803083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-DeleteServersTestJSON-635157655-project Jul 19 20:50:22.803083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:50:22.803083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:50:22.803083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: 20eed246b8e140688a628664f29e38a4 Jul 19 20:50:22.803083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-DeleteServersTestJSON-635157655-project Jul 19 20:50:22.803083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:50:22.803083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:22.803083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'server_id': '62b03a24-f1b1-4dd1-bbe4-2e017296709b'} Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:50:22.803808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:22.805463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:50:22.808257 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9ede37f3-5710-478e-a8ea-64b36dc90ccd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Returning 404 to user: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:50:22.810461 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9ede37f3-5710-478e-a8ea-64b36dc90ccd tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.088998 Jul 19 20:50:22.811694 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 90/205] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:50:22 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b/os-volume_attachments => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:50:22.893166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-685a0081-525d-48a4-84fd-8808277e56e4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:22.894204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-685a0081-525d-48a4-84fd-8808277e56e4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:22.907967 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-685a0081-525d-48a4-84fd-8808277e56e4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:22.907967 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-685a0081-525d-48a4-84fd-8808277e56e4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:22.907967 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-685a0081-525d-48a4-84fd-8808277e56e4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:22.907967 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-685a0081-525d-48a4-84fd-8808277e56e4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:23.176359 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-685a0081-525d-48a4-84fd-8808277e56e4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:23.190162 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-685a0081-525d-48a4-84fd-8808277e56e4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.301565 Jul 19 20:50:23.190828 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 116/206] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:22 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:24.209274 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8b9e7798-9faf-42c7-ab4a-cf41c180615c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:24.209967 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8b9e7798-9faf-42c7-ab4a-cf41c180615c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:24.217729 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8b9e7798-9faf-42c7-ab4a-cf41c180615c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:24.218284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8b9e7798-9faf-42c7-ab4a-cf41c180615c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:24.219459 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8b9e7798-9faf-42c7-ab4a-cf41c180615c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:24.219893 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8b9e7798-9faf-42c7-ab4a-cf41c180615c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:24.299094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-12413e5c-a75d-46ef-a11b-034296a762a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:24.299680 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-12413e5c-a75d-46ef-a11b-034296a762a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:24.306125 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12413e5c-a75d-46ef-a11b-034296a762a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:24.306579 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12413e5c-a75d-46ef-a11b-034296a762a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:24.307377 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12413e5c-a75d-46ef-a11b-034296a762a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:24.307823 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12413e5c-a75d-46ef-a11b-034296a762a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:24.328075 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-12413e5c-a75d-46ef-a11b-034296a762a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] HTTP exception thrown: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-12413e5c-a75d-46ef-a11b-034296a762a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Request method failure captured: Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: DELETE /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b HTTP/1.1 Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjCCie2K034uXKH37y61dwtswjOc7W5ZQgUvUs8nistWg2XdxBjaDT7IZ-41ESdkCHYzJmCkxLpWj__6lvQ9gOLzRcECDugAEHSs0Bsby0-Zcfq7186SYgE2aTlTeh92KyLxw1twJ9zTefk8UjFGSQnvzY3k6AyvxPCk76kcC3m_Pg Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 0efbb2e43cc74d63ad721e3971e7b181 Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-DeleteServersTestJSON-635157655 Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:50:24.330518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:50:24.331969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0efbb2e43cc74d63ad721e3971e7b181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0efbb2e43cc74d63ad721e3971e7b181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0efbb2e43cc74d63ad721e3971e7b181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0efbb2e43cc74d63ad721e3971e7b181", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:50:24.331969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-DeleteServersTestJSON-635157655 Jul 19 20:50:24.331969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 0efbb2e43cc74d63ad721e3971e7b181 Jul 19 20:50:24.331969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-DeleteServersTestJSON-635157655 Jul 19 20:50:24.331969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-DeleteServersTestJSON-635157655-project Jul 19 20:50:24.331969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:50:24.331969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:50:24.331969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: 20eed246b8e140688a628664f29e38a4 Jul 19 20:50:24.331969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-DeleteServersTestJSON-635157655-project Jul 19 20:50:24.331969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:50:24.331969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:24.331969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '62b03a24-f1b1-4dd1-bbe4-2e017296709b'} Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:50:24.332782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:24.334205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:24.336401 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-12413e5c-a75d-46ef-a11b-034296a762a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Returning 404 to user: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:50:24.337633 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-12413e5c-a75d-46ef-a11b-034296a762a5 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "DELETE /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 404 len: 111 microversion: 2.1 time: 0.042459 Jul 19 20:50:24.338374 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 117/207] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:50:24 2022] DELETE /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:50:24.350095 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2fda6aa4-5ff2-41a6-ae74-dd2cded6db04 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:24.352813 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2fda6aa4-5ff2-41a6-ae74-dd2cded6db04 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] [instance: 62b03a24-f1b1-4dd1-bbe4-2e017296709b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:24.363366 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2fda6aa4-5ff2-41a6-ae74-dd2cded6db04 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:24.364235 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2fda6aa4-5ff2-41a6-ae74-dd2cded6db04 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:24.365703 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2fda6aa4-5ff2-41a6-ae74-dd2cded6db04 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:24.366340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2fda6aa4-5ff2-41a6-ae74-dd2cded6db04 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:24.406120 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-2fda6aa4-5ff2-41a6-ae74-dd2cded6db04 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] HTTP exception thrown: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2fda6aa4-5ff2-41a6-ae74-dd2cded6db04 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Request method failure captured: Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b HTTP/1.1 Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjCCie2K034uXKH37y61dwtswjOc7W5ZQgUvUs8nistWg2XdxBjaDT7IZ-41ESdkCHYzJmCkxLpWj__6lvQ9gOLzRcECDugAEHSs0Bsby0-Zcfq7186SYgE2aTlTeh92KyLxw1twJ9zTefk8UjFGSQnvzY3k6AyvxPCk76kcC3m_Pg Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 0efbb2e43cc74d63ad721e3971e7b181 Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-DeleteServersTestJSON-635157655 Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:50:24.408336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:50:24.409890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0efbb2e43cc74d63ad721e3971e7b181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0efbb2e43cc74d63ad721e3971e7b181"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0efbb2e43cc74d63ad721e3971e7b181"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0efbb2e43cc74d63ad721e3971e7b181", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:50:24.409890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-DeleteServersTestJSON-635157655 Jul 19 20:50:24.409890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 0efbb2e43cc74d63ad721e3971e7b181 Jul 19 20:50:24.409890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-DeleteServersTestJSON-635157655 Jul 19 20:50:24.409890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-DeleteServersTestJSON-635157655-project Jul 19 20:50:24.409890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:50:24.409890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:50:24.409890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: 20eed246b8e140688a628664f29e38a4 Jul 19 20:50:24.409890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-DeleteServersTestJSON-635157655-project Jul 19 20:50:24.409890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:50:24.409890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:24.409890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '62b03a24-f1b1-4dd1-bbe4-2e017296709b'} Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:50:24.410843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. Jul 19 20:50:24.412531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:50:24.413787 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2fda6aa4-5ff2-41a6-ae74-dd2cded6db04 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] Returning 404 to user: Instance 62b03a24-f1b1-4dd1-bbe4-2e017296709b could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:50:24.415393 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2fda6aa4-5ff2-41a6-ae74-dd2cded6db04 tempest-DeleteServersTestJSON-635157655 tempest-DeleteServersTestJSON-635157655-project] 10.222.0.70 "GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b" status: 404 len: 111 microversion: 2.1 time: 0.071708 Jul 19 20:50:24.416498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 118/208] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:24 2022] GET /compute/v2.1/servers/62b03a24-f1b1-4dd1-bbe4-2e017296709b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:50:24.439080 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8b9e7798-9faf-42c7-ab4a-cf41c180615c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:24.447390 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8b9e7798-9faf-42c7-ab4a-cf41c180615c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.242311 Jul 19 20:50:24.447973 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 91/209] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:24 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:25.465129 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-72674ffc-b042-4861-bd6c-2cd2ea5671fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:25.465873 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-72674ffc-b042-4861-bd6c-2cd2ea5671fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:25.474009 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72674ffc-b042-4861-bd6c-2cd2ea5671fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:25.474435 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72674ffc-b042-4861-bd6c-2cd2ea5671fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:25.475162 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72674ffc-b042-4861-bd6c-2cd2ea5671fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:25.475599 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72674ffc-b042-4861-bd6c-2cd2ea5671fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:25.636918 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-72674ffc-b042-4861-bd6c-2cd2ea5671fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:25.646238 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-72674ffc-b042-4861-bd6c-2cd2ea5671fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.185098 Jul 19 20:50:25.647626 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 119/210] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:25 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:26.663334 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-bd495129-40c7-48a3-9558-b4a539160f82 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:26.663970 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-bd495129-40c7-48a3-9558-b4a539160f82 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:26.671753 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bd495129-40c7-48a3-9558-b4a539160f82 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:26.672577 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bd495129-40c7-48a3-9558-b4a539160f82 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:26.673610 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bd495129-40c7-48a3-9558-b4a539160f82 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:26.674257 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bd495129-40c7-48a3-9558-b4a539160f82 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:26.830481 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-bd495129-40c7-48a3-9558-b4a539160f82 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:26.840337 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-bd495129-40c7-48a3-9558-b4a539160f82 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.180974 Jul 19 20:50:26.841293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 92/211] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:26 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:27.856845 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-58a14cd4-d270-42dc-b0dc-067d2f9a22f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:27.857672 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-58a14cd4-d270-42dc-b0dc-067d2f9a22f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:27.866694 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-58a14cd4-d270-42dc-b0dc-067d2f9a22f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:27.867850 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-58a14cd4-d270-42dc-b0dc-067d2f9a22f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:27.869246 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-58a14cd4-d270-42dc-b0dc-067d2f9a22f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:27.873438 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-58a14cd4-d270-42dc-b0dc-067d2f9a22f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:28.192775 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-58a14cd4-d270-42dc-b0dc-067d2f9a22f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:28.201025 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-58a14cd4-d270-42dc-b0dc-067d2f9a22f9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.347932 Jul 19 20:50:28.201963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 120/212] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:27 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:29.219209 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d2b7b344-e67e-4e4d-b9d2-4085a2b11423 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:29.219952 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d2b7b344-e67e-4e4d-b9d2-4085a2b11423 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:29.227357 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2b7b344-e67e-4e4d-b9d2-4085a2b11423 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:29.227812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2b7b344-e67e-4e4d-b9d2-4085a2b11423 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:29.229033 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2b7b344-e67e-4e4d-b9d2-4085a2b11423 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:29.229775 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2b7b344-e67e-4e4d-b9d2-4085a2b11423 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:29.411835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d2b7b344-e67e-4e4d-b9d2-4085a2b11423 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:29.425808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d2b7b344-e67e-4e4d-b9d2-4085a2b11423 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.210590 Jul 19 20:50:29.436944 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 93/213] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:29 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:30.444170 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-1fe981b1-6a84-4b47-8efb-f7907bde2af1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:30.444885 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-1fe981b1-6a84-4b47-8efb-f7907bde2af1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:30.451242 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1fe981b1-6a84-4b47-8efb-f7907bde2af1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:30.452047 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1fe981b1-6a84-4b47-8efb-f7907bde2af1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:30.453035 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1fe981b1-6a84-4b47-8efb-f7907bde2af1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:30.454285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1fe981b1-6a84-4b47-8efb-f7907bde2af1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:30.642479 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-1fe981b1-6a84-4b47-8efb-f7907bde2af1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:30.653762 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-1fe981b1-6a84-4b47-8efb-f7907bde2af1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.213230 Jul 19 20:50:30.664450 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 121/214] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:30 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:31.674706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-44fdce9a-66c1-466d-805b-5435c23250e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:31.675509 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-44fdce9a-66c1-466d-805b-5435c23250e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:31.682295 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-44fdce9a-66c1-466d-805b-5435c23250e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:31.683553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-44fdce9a-66c1-466d-805b-5435c23250e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:31.684584 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-44fdce9a-66c1-466d-805b-5435c23250e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:31.685548 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-44fdce9a-66c1-466d-805b-5435c23250e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:32.082431 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-44fdce9a-66c1-466d-805b-5435c23250e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:32.119168 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-44fdce9a-66c1-466d-805b-5435c23250e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.449015 Jul 19 20:50:32.120098 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 94/215] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:31 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:33.143145 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2fb52290-0717-4d00-b5ac-77656fa057f1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:33.144167 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2fb52290-0717-4d00-b5ac-77656fa057f1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:33.165321 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:33.172484 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2fb52290-0717-4d00-b5ac-77656fa057f1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:33.173105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2fb52290-0717-4d00-b5ac-77656fa057f1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:33.175575 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2fb52290-0717-4d00-b5ac-77656fa057f1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:33.176505 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2fb52290-0717-4d00-b5ac-77656fa057f1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:33.778934 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2fb52290-0717-4d00-b5ac-77656fa057f1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:33.791476 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2fb52290-0717-4d00-b5ac-77656fa057f1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.656903 Jul 19 20:50:33.805917 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 122/216] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:33 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:34.810938 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-15adbb76-a50f-424d-973f-5bdde5259b06 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:34.811534 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-15adbb76-a50f-424d-973f-5bdde5259b06 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:34.819622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-15adbb76-a50f-424d-973f-5bdde5259b06 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:34.820076 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-15adbb76-a50f-424d-973f-5bdde5259b06 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:34.820855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-15adbb76-a50f-424d-973f-5bdde5259b06 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:34.821328 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-15adbb76-a50f-424d-973f-5bdde5259b06 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:35.050913 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-15adbb76-a50f-424d-973f-5bdde5259b06 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:35.062690 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-15adbb76-a50f-424d-973f-5bdde5259b06 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.255872 Jul 19 20:50:35.063330 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 95/217] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:34 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:35.976143 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1795582452", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "networks": [{"uuid": "9fe2abf4-f92d-4e59-ac1e-b9cea613fe5d"}]}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:36.070832 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.network.neutron [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] validate_networks() for [('9fe2abf4-f92d-4e59-ac1e-b9cea613fe5d', None, None, None, None, None)] {{(pid=129866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:50:36.085603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fba583a7-36f4-4ae2-8458-a5ba32e255e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:36.090281 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-fba583a7-36f4-4ae2-8458-a5ba32e255e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:36.103142 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=58 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:36.105170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fba583a7-36f4-4ae2-8458-a5ba32e255e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:36.119602 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fba583a7-36f4-4ae2-8458-a5ba32e255e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:36.124234 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fba583a7-36f4-4ae2-8458-a5ba32e255e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:36.127391 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fba583a7-36f4-4ae2-8458-a5ba32e255e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:36.487909 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-fba583a7-36f4-4ae2-8458-a5ba32e255e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:36.498367 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fba583a7-36f4-4ae2-8458-a5ba32e255e5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1521 microversion: 2.1 time: 0.421659 Jul 19 20:50:36.515336 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 96/218] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:36 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:36.868963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Flavor limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:50:36.869582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Image limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:50:36.870270 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Flavor pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:50:36.870963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Image pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:50:36.871736 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:50:36.890906 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:36.895410 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:36.898175 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:36.900234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:36.965193 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Getting quotas for project 0bc1c7a8029e4d40ac256dd2f877317b. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:50:36.983251 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Getting quotas for user 6f3e4ee4b3ca492cabf2622f0659b5a5 and project 0bc1c7a8029e4d40ac256dd2f877317b. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:50:37.022143 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Going to run 1 instances... {{(pid=129866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:50:37.027377 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:50:37.125079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-58f7033a-42de-4d30-8f46-1474fcaf2901 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143568 Jul 19 20:50:37.132194 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 123/219] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:50:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:50:37.142653 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-89b56736-a494-4654-bedc-1c32b1cf5519 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:37.143327 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-89b56736-a494-4654-bedc-1c32b1cf5519 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:37.287133 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-89b56736-a494-4654-bedc-1c32b1cf5519 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:37.295948 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-89b56736-a494-4654-bedc-1c32b1cf5519 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1214 microversion: 2.1 time: 0.157495 Jul 19 20:50:37.309083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 97/220] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:37 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:37.523035 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-56226f03-9c22-4a29-8824-d83b427f9185 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:37.523658 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-56226f03-9c22-4a29-8824-d83b427f9185 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:37.538514 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-56226f03-9c22-4a29-8824-d83b427f9185 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:37.539152 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-56226f03-9c22-4a29-8824-d83b427f9185 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:37.545484 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-56226f03-9c22-4a29-8824-d83b427f9185 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:37.548241 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-56226f03-9c22-4a29-8824-d83b427f9185 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:37.721015 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a57e6bfd-c607-4669-9678-c81d5763b1dc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Action: 'create', calling method: .version_select at 0x7f25341ceb80>, body: {"keypair": {"name": "tempest-keypair-1666159502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2vO0WHkuLxAKPA9WjR3REeqg1j2egFSFFAminTlFeMLek+Ily8goKcNSemBAcylRDL0rQQ9g2/DXOKztXsi83kJXDeBvumTcNhDIWx/vqMXRfpbyUBFBcMmGn8MmTwog=="}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:37.756483 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-a57e6bfd-c607-4669-9678-c81d5763b1dc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Getting quotas for project a35c1526c58f4c2b9b44a4de6c945846. Resources: {'key_pairs'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:50:37.770157 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-a57e6bfd-c607-4669-9678-c81d5763b1dc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Getting quotas for user cbcb993e2d1842389c5862f0fdb7d4d7 and project a35c1526c58f4c2b9b44a4de6c945846. Resources: {'key_pairs'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:50:37.830563 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a57e6bfd-c607-4669-9678-c81d5763b1dc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.425120 Jul 19 20:50:37.839119 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 124/221] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jul 19 20:50:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:37.876724 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-56226f03-9c22-4a29-8824-d83b427f9185 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:37.881918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=100 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:37.896131 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-56226f03-9c22-4a29-8824-d83b427f9185 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1501 microversion: 2.1 time: 0.377013 Jul 19 20:50:37.899721 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 98/222] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:37 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1501 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:37.922286 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b98d7993-1358-4c3d-8be8-5db7232b7ba8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:37.923657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b98d7993-1358-4c3d-8be8-5db7232b7ba8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:37.932934 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b98d7993-1358-4c3d-8be8-5db7232b7ba8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:37.933423 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b98d7993-1358-4c3d-8be8-5db7232b7ba8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:37.935047 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b98d7993-1358-4c3d-8be8-5db7232b7ba8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:37.935550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b98d7993-1358-4c3d-8be8-5db7232b7ba8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:38.203365 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b98d7993-1358-4c3d-8be8-5db7232b7ba8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:38.215278 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b98d7993-1358-4c3d-8be8-5db7232b7ba8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1516 microversion: 2.1 time: 0.300730 Jul 19 20:50:38.216023 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 125/223] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:37 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1516 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:38.315437 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a0891847-60ab-489a-afb8-67e718f43b8f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:38.316168 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a0891847-60ab-489a-afb8-67e718f43b8f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:38.325932 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a0891847-60ab-489a-afb8-67e718f43b8f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:38.326783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a0891847-60ab-489a-afb8-67e718f43b8f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:38.327875 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a0891847-60ab-489a-afb8-67e718f43b8f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:38.328662 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a0891847-60ab-489a-afb8-67e718f43b8f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:38.428840 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a0891847-60ab-489a-afb8-67e718f43b8f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:38.441696 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a0891847-60ab-489a-afb8-67e718f43b8f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1266 microversion: 2.1 time: 0.132247 Jul 19 20:50:38.445808 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 99/224] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:38 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:39.463313 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-84abab28-5d68-4f46-b943-30c7cfadb683 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:39.464885 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-84abab28-5d68-4f46-b943-30c7cfadb683 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:39.477034 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-84abab28-5d68-4f46-b943-30c7cfadb683 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:39.478312 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-84abab28-5d68-4f46-b943-30c7cfadb683 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:39.479286 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-84abab28-5d68-4f46-b943-30c7cfadb683 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:39.479958 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-84abab28-5d68-4f46-b943-30c7cfadb683 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:39.556508 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-84abab28-5d68-4f46-b943-30c7cfadb683 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:39.563493 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-595336803", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90c4c149-ef7c-4874-8f2b-fb097608ec8f"}], "security_groups": [{"name": "tempest-securitygroup--1501130"}], "key_name": "tempest-keypair-1666159502", "user_data": "}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:39.564265 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-84abab28-5d68-4f46-b943-30c7cfadb683 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1266 microversion: 2.1 time: 0.107941 Jul 19 20:50:39.564846 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 126/225] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:39 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:39.676673 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.network.neutron [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] validate_networks() for [('90c4c149-ef7c-4874-8f2b-fb097608ec8f', None, None, None, None, None)] {{(pid=129867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:50:40.335565 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Flavor limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:50:40.336499 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Image limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:50:40.337479 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Flavor pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:50:40.338460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Image pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:50:40.339180 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:50:40.356516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:40.357286 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:40.358829 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:40.359461 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:40.402650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Getting quotas for project a35c1526c58f4c2b9b44a4de6c945846. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:50:40.412612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Getting quotas for user cbcb993e2d1842389c5862f0fdb7d4d7 and project a35c1526c58f4c2b9b44a4de6c945846. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:50:40.429605 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Going to run 1 instances... {{(pid=129867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:50:40.432034 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:50:40.497342 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d6a789d4-23cc-400a-bea5-47ba9e739420 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.938116 Jul 19 20:50:40.498372 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 100/226] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:50:39 2022] POST /compute/v2.1/servers => generated 399 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:50:40.510987 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-abbe4b65-0de5-4fe9-a419-4b33a2285280 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:40.511869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-abbe4b65-0de5-4fe9-a419-4b33a2285280 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:40.583673 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-393d7413-f89b-467d-aeb3-d8ea4a7c692a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:40.584965 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-393d7413-f89b-467d-aeb3-d8ea4a7c692a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:40.585885 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-abbe4b65-0de5-4fe9-a419-4b33a2285280 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:40.595852 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-393d7413-f89b-467d-aeb3-d8ea4a7c692a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:40.596136 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-abbe4b65-0de5-4fe9-a419-4b33a2285280 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1237 microversion: 2.1 time: 0.090452 Jul 19 20:50:40.605028 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 127/227] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:40 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:40.605970 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-393d7413-f89b-467d-aeb3-d8ea4a7c692a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:40.607460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-393d7413-f89b-467d-aeb3-d8ea4a7c692a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:40.608358 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-393d7413-f89b-467d-aeb3-d8ea4a7c692a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:40.686348 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-393d7413-f89b-467d-aeb3-d8ea4a7c692a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:40.697167 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-393d7413-f89b-467d-aeb3-d8ea4a7c692a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1266 microversion: 2.1 time: 0.118461 Jul 19 20:50:40.697865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 101/228] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:40 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:41.620917 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e7729705-81c4-461d-a423-cb214e1dec4f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:41.621707 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e7729705-81c4-461d-a423-cb214e1dec4f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:41.628826 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e7729705-81c4-461d-a423-cb214e1dec4f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:41.629400 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e7729705-81c4-461d-a423-cb214e1dec4f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:41.630271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e7729705-81c4-461d-a423-cb214e1dec4f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:41.630776 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e7729705-81c4-461d-a423-cb214e1dec4f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:41.655155 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=100 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:41.714754 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a86eda98-a741-40af-bbc1-12fe94d48f75 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:41.715349 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a86eda98-a741-40af-bbc1-12fe94d48f75 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:41.716210 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e7729705-81c4-461d-a423-cb214e1dec4f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:41.722924 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a86eda98-a741-40af-bbc1-12fe94d48f75 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:41.723375 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a86eda98-a741-40af-bbc1-12fe94d48f75 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:41.724151 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a86eda98-a741-40af-bbc1-12fe94d48f75 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:41.724590 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a86eda98-a741-40af-bbc1-12fe94d48f75 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:41.725747 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e7729705-81c4-461d-a423-cb214e1dec4f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1241 microversion: 2.1 time: 0.108655 Jul 19 20:50:41.726415 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 128/229] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:41 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:41.796011 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a86eda98-a741-40af-bbc1-12fe94d48f75 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:41.810129 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a86eda98-a741-40af-bbc1-12fe94d48f75 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1266 microversion: 2.1 time: 0.098246 Jul 19 20:50:41.811395 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 102/230] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:41 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:42.757346 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e447622d-c55a-4664-87a3-52c1c5ff8e41 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:42.758763 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e447622d-c55a-4664-87a3-52c1c5ff8e41 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:42.770683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e447622d-c55a-4664-87a3-52c1c5ff8e41 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:42.771516 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e447622d-c55a-4664-87a3-52c1c5ff8e41 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:42.772705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e447622d-c55a-4664-87a3-52c1c5ff8e41 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:42.773395 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e447622d-c55a-4664-87a3-52c1c5ff8e41 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:42.834613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7817e52c-2505-42a8-a676-fa5488f17972 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:42.836090 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7817e52c-2505-42a8-a676-fa5488f17972 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:42.858262 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7817e52c-2505-42a8-a676-fa5488f17972 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:42.859185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7817e52c-2505-42a8-a676-fa5488f17972 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:42.861577 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7817e52c-2505-42a8-a676-fa5488f17972 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:42.862544 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7817e52c-2505-42a8-a676-fa5488f17972 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:42.937048 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e447622d-c55a-4664-87a3-52c1c5ff8e41 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:42.963185 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e447622d-c55a-4664-87a3-52c1c5ff8e41 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1241 microversion: 2.1 time: 0.213729 Jul 19 20:50:42.969803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 129/231] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:42 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1241 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:43.098746 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7817e52c-2505-42a8-a676-fa5488f17972 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:43.120139 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7817e52c-2505-42a8-a676-fa5488f17972 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1274 microversion: 2.1 time: 0.292967 Jul 19 20:50:43.141634 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 103/232] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:42 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1274 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:43.999569 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f1dc6ecf-9e2c-47f5-8466-af0949ecf268 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:44.004865 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f1dc6ecf-9e2c-47f5-8466-af0949ecf268 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:44.018885 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f1dc6ecf-9e2c-47f5-8466-af0949ecf268 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:44.020097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f1dc6ecf-9e2c-47f5-8466-af0949ecf268 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:44.022505 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f1dc6ecf-9e2c-47f5-8466-af0949ecf268 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:44.023773 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f1dc6ecf-9e2c-47f5-8466-af0949ecf268 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:44.157637 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-1e2f5fa4-646a-4424-8cd5-a600e3053482 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:44.162856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-1e2f5fa4-646a-4424-8cd5-a600e3053482 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:44.185605 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1e2f5fa4-646a-4424-8cd5-a600e3053482 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:44.186186 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1e2f5fa4-646a-4424-8cd5-a600e3053482 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:44.187104 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1e2f5fa4-646a-4424-8cd5-a600e3053482 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:44.189467 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1e2f5fa4-646a-4424-8cd5-a600e3053482 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:44.200883 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f1dc6ecf-9e2c-47f5-8466-af0949ecf268 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:44.212022 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f1dc6ecf-9e2c-47f5-8466-af0949ecf268 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1295 microversion: 2.1 time: 0.225292 Jul 19 20:50:44.213176 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 130/233] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:43 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1295 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:44.220109 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-bf3eac47-50ce-4868-8f9a-b9498650544c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:44.222350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-bf3eac47-50ce-4868-8f9a-b9498650544c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:44.234088 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bf3eac47-50ce-4868-8f9a-b9498650544c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:44.235647 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bf3eac47-50ce-4868-8f9a-b9498650544c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:44.237014 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bf3eac47-50ce-4868-8f9a-b9498650544c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:44.238023 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bf3eac47-50ce-4868-8f9a-b9498650544c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:44.285762 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-bf3eac47-50ce-4868-8f9a-b9498650544c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lazy-loading 'flavor' on Instance uuid b07400b5-bd6a-4841-a97c-3c7e6704de6a {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:50:44.452196 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-bf3eac47-50ce-4868-8f9a-b9498650544c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "POST /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a/action" status: 200 len: 32 microversion: 2.1 time: 0.236704 Jul 19 20:50:44.457441 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 131/234] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 20:50:44 2022] POST /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a/action => generated 32 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:50:44.476498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-36367b4b-d6dd-4f73-b102-ff21d46bdefa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:44.478522 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-36367b4b-d6dd-4f73-b102-ff21d46bdefa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:44.494480 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1e2f5fa4-646a-4424-8cd5-a600e3053482 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:44.505558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-36367b4b-d6dd-4f73-b102-ff21d46bdefa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:44.506005 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-1e2f5fa4-646a-4424-8cd5-a600e3053482 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1314 microversion: 2.1 time: 0.356543 Jul 19 20:50:44.506726 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-36367b4b-d6dd-4f73-b102-ff21d46bdefa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:44.507662 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 104/235] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:44 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:44.515225 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-36367b4b-d6dd-4f73-b102-ff21d46bdefa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:44.517710 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-36367b4b-d6dd-4f73-b102-ff21d46bdefa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:44.764341 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-36367b4b-d6dd-4f73-b102-ff21d46bdefa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:44.775872 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-36367b4b-d6dd-4f73-b102-ff21d46bdefa tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.310349 Jul 19 20:50:44.776863 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 132/236] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:44 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:45.238750 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f5d73f69-0bde-422d-ae4a-f9997ee8b23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:45.239305 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f5d73f69-0bde-422d-ae4a-f9997ee8b23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:45.245836 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f5d73f69-0bde-422d-ae4a-f9997ee8b23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:45.246293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f5d73f69-0bde-422d-ae4a-f9997ee8b23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:45.247325 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f5d73f69-0bde-422d-ae4a-f9997ee8b23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:45.247513 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f5d73f69-0bde-422d-ae4a-f9997ee8b23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:45.321467 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f5d73f69-0bde-422d-ae4a-f9997ee8b23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:45.330004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f5d73f69-0bde-422d-ae4a-f9997ee8b23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1295 microversion: 2.1 time: 0.095840 Jul 19 20:50:45.331029 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 105/237] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:45 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:45.532412 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-35479e0f-4b87-428f-aeb5-3e16ac5edcf0 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:45.533267 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-35479e0f-4b87-428f-aeb5-3e16ac5edcf0 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:45.539657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-35479e0f-4b87-428f-aeb5-3e16ac5edcf0 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:45.540107 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-35479e0f-4b87-428f-aeb5-3e16ac5edcf0 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:45.540873 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-35479e0f-4b87-428f-aeb5-3e16ac5edcf0 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:45.541305 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-35479e0f-4b87-428f-aeb5-3e16ac5edcf0 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:45.710063 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-35479e0f-4b87-428f-aeb5-3e16ac5edcf0 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:45.719984 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-35479e0f-4b87-428f-aeb5-3e16ac5edcf0 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1314 microversion: 2.1 time: 0.190919 Jul 19 20:50:45.723788 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 133/238] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:45 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:45.801036 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-491ebe82-5807-46d5-afc0-e7efd1ec52b8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:45.801693 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-491ebe82-5807-46d5-afc0-e7efd1ec52b8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:45.809273 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-491ebe82-5807-46d5-afc0-e7efd1ec52b8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:45.809861 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-491ebe82-5807-46d5-afc0-e7efd1ec52b8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:45.810718 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-491ebe82-5807-46d5-afc0-e7efd1ec52b8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:45.811534 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-491ebe82-5807-46d5-afc0-e7efd1ec52b8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:46.022975 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-491ebe82-5807-46d5-afc0-e7efd1ec52b8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:46.041192 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-491ebe82-5807-46d5-afc0-e7efd1ec52b8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.250144 Jul 19 20:50:46.042055 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 106/239] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:45 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:46.354827 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3ed82906-02b6-4fc2-bb26-1420673fd7de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:46.356856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3ed82906-02b6-4fc2-bb26-1420673fd7de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:46.374925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ed82906-02b6-4fc2-bb26-1420673fd7de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:46.375465 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ed82906-02b6-4fc2-bb26-1420673fd7de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:46.376397 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ed82906-02b6-4fc2-bb26-1420673fd7de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:46.376891 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ed82906-02b6-4fc2-bb26-1420673fd7de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:46.437713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-6ea8783a-0d0e-475c-baa6-608939df4413 req-97156770-ecba-4574-85ea-44fe86a777e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c312c637-f13f-4bf4-a188-154c94f925a3", "tag": "4b6a555d-5cef-44f1-ad60-ba83296ef946"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:46.477180 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-6ea8783a-0d0e-475c-baa6-608939df4413 req-97156770-ecba-4574-85ea-44fe86a777e0 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:46.478058 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-6ea8783a-0d0e-475c-baa6-608939df4413 req-97156770-ecba-4574-85ea-44fe86a777e0 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:46.494643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-6ea8783a-0d0e-475c-baa6-608939df4413 req-97156770-ecba-4574-85ea-44fe86a777e0 service nova] Creating event network-changed:4b6a555d-5cef-44f1-ad60-ba83296ef946 for instance c312c637-f13f-4bf4-a188-154c94f925a3 on hv-cinder-79987 Jul 19 20:50:46.501981 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-6ea8783a-0d0e-475c-baa6-608939df4413 req-97156770-ecba-4574-85ea-44fe86a777e0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078639 Jul 19 20:50:46.503185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 107/240] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:46.571474 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3ed82906-02b6-4fc2-bb26-1420673fd7de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:46.580927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3ed82906-02b6-4fc2-bb26-1420673fd7de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.233994 Jul 19 20:50:46.581926 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 134/241] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:46 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:46.743089 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2955ea0e-a284-498f-8b25-22fdb779d27c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:46.743803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2955ea0e-a284-498f-8b25-22fdb779d27c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:46.751398 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2955ea0e-a284-498f-8b25-22fdb779d27c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:46.751945 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2955ea0e-a284-498f-8b25-22fdb779d27c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:46.752733 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2955ea0e-a284-498f-8b25-22fdb779d27c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:46.753293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2955ea0e-a284-498f-8b25-22fdb779d27c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:46.966277 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2955ea0e-a284-498f-8b25-22fdb779d27c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:46.982547 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2955ea0e-a284-498f-8b25-22fdb779d27c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1314 microversion: 2.1 time: 0.241906 Jul 19 20:50:46.989222 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 108/242] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:46 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:47.076054 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-cc3afdd4-2f7b-41ed-b195-1cc9c96a663f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:47.076790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-cc3afdd4-2f7b-41ed-b195-1cc9c96a663f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:47.083048 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:47.085797 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cc3afdd4-2f7b-41ed-b195-1cc9c96a663f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:47.086269 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cc3afdd4-2f7b-41ed-b195-1cc9c96a663f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:47.087065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cc3afdd4-2f7b-41ed-b195-1cc9c96a663f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:47.087706 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cc3afdd4-2f7b-41ed-b195-1cc9c96a663f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:47.264386 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-cc3afdd4-2f7b-41ed-b195-1cc9c96a663f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:47.277576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-cc3afdd4-2f7b-41ed-b195-1cc9c96a663f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.208657 Jul 19 20:50:47.292457 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 135/243] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:47 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:47.601054 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-add43f10-aa23-40f1-95ac-d3117e4954d6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:47.602024 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-add43f10-aa23-40f1-95ac-d3117e4954d6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:47.608584 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-add43f10-aa23-40f1-95ac-d3117e4954d6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:47.609060 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-add43f10-aa23-40f1-95ac-d3117e4954d6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:47.610049 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-add43f10-aa23-40f1-95ac-d3117e4954d6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:47.610484 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-add43f10-aa23-40f1-95ac-d3117e4954d6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:47.758980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-add43f10-aa23-40f1-95ac-d3117e4954d6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:47.769608 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-add43f10-aa23-40f1-95ac-d3117e4954d6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.173805 Jul 19 20:50:47.770359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 109/244] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:47 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:48.010163 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ec08c294-45f9-42dc-b4e4-e9d61809de7c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:48.010776 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ec08c294-45f9-42dc-b4e4-e9d61809de7c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:48.017324 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ec08c294-45f9-42dc-b4e4-e9d61809de7c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:48.017806 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ec08c294-45f9-42dc-b4e4-e9d61809de7c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:48.018589 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ec08c294-45f9-42dc-b4e4-e9d61809de7c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:48.019030 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ec08c294-45f9-42dc-b4e4-e9d61809de7c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:48.155295 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ec08c294-45f9-42dc-b4e4-e9d61809de7c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:48.165402 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ec08c294-45f9-42dc-b4e4-e9d61809de7c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1314 microversion: 2.1 time: 0.157897 Jul 19 20:50:48.165402 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 136/245] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:48 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:48.299604 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9750d36d-45e7-4460-9b40-15132603a24d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:48.300220 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9750d36d-45e7-4460-9b40-15132603a24d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:48.306296 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9750d36d-45e7-4460-9b40-15132603a24d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:48.306741 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9750d36d-45e7-4460-9b40-15132603a24d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:48.307490 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9750d36d-45e7-4460-9b40-15132603a24d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:48.307927 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9750d36d-45e7-4460-9b40-15132603a24d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:48.450522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9750d36d-45e7-4460-9b40-15132603a24d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:48.459828 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9750d36d-45e7-4460-9b40-15132603a24d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.164880 Jul 19 20:50:48.460430 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 110/246] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:48 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:48.518164 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-31679ce1-1991-4096-8440-2cffeb9107eb req-c00aab8a-e786-4e64-9a75-246dbf03d243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c44e702b-f4f1-46e4-8552-a9440c7b13db", "tag": "5659d43b-6dee-4967-bcd6-71cb55872ddb"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:48.526380 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-31679ce1-1991-4096-8440-2cffeb9107eb req-c00aab8a-e786-4e64-9a75-246dbf03d243 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:48.526914 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-31679ce1-1991-4096-8440-2cffeb9107eb req-c00aab8a-e786-4e64-9a75-246dbf03d243 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:48.538651 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-31679ce1-1991-4096-8440-2cffeb9107eb req-c00aab8a-e786-4e64-9a75-246dbf03d243 service nova] Creating event network-changed:5659d43b-6dee-4967-bcd6-71cb55872ddb for instance c44e702b-f4f1-46e4-8552-a9440c7b13db on hv-cinder-79987 Jul 19 20:50:48.546152 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-31679ce1-1991-4096-8440-2cffeb9107eb req-c00aab8a-e786-4e64-9a75-246dbf03d243 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032153 Jul 19 20:50:48.547250 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 137/247] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:48.789057 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8461dac2-d8fe-448e-aa5e-aa6a5737ea36 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:48.789712 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8461dac2-d8fe-448e-aa5e-aa6a5737ea36 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:48.798250 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8461dac2-d8fe-448e-aa5e-aa6a5737ea36 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:48.799071 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8461dac2-d8fe-448e-aa5e-aa6a5737ea36 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:48.800347 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8461dac2-d8fe-448e-aa5e-aa6a5737ea36 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:48.800803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8461dac2-d8fe-448e-aa5e-aa6a5737ea36 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:48.979477 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8461dac2-d8fe-448e-aa5e-aa6a5737ea36 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:48.987918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8461dac2-d8fe-448e-aa5e-aa6a5737ea36 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.204220 Jul 19 20:50:48.988658 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 111/248] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:48 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:49.184628 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-120b7efd-fa62-4858-8217-7e5071d42510 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:49.185469 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-120b7efd-fa62-4858-8217-7e5071d42510 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:49.192338 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-120b7efd-fa62-4858-8217-7e5071d42510 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:49.192869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-120b7efd-fa62-4858-8217-7e5071d42510 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:49.193672 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-120b7efd-fa62-4858-8217-7e5071d42510 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:49.194103 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-120b7efd-fa62-4858-8217-7e5071d42510 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:49.339432 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-120b7efd-fa62-4858-8217-7e5071d42510 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:49.347396 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-120b7efd-fa62-4858-8217-7e5071d42510 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1314 microversion: 2.1 time: 0.166776 Jul 19 20:50:49.348090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 138/249] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:49 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:49.476580 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d833071d-2dce-4c6d-a81d-2032c70f7348 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:49.477348 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d833071d-2dce-4c6d-a81d-2032c70f7348 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:49.483720 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d833071d-2dce-4c6d-a81d-2032c70f7348 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:49.484166 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d833071d-2dce-4c6d-a81d-2032c70f7348 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:49.485500 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d833071d-2dce-4c6d-a81d-2032c70f7348 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:49.486018 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d833071d-2dce-4c6d-a81d-2032c70f7348 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:49.628829 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d833071d-2dce-4c6d-a81d-2032c70f7348 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:49.636403 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d833071d-2dce-4c6d-a81d-2032c70f7348 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.163588 Jul 19 20:50:49.636984 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 112/250] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:49 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:50.007922 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f3694a18-1ab2-4ebe-b1cd-a9236bc5bad9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:50.008754 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f3694a18-1ab2-4ebe-b1cd-a9236bc5bad9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:50.018962 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f3694a18-1ab2-4ebe-b1cd-a9236bc5bad9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:50.019592 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f3694a18-1ab2-4ebe-b1cd-a9236bc5bad9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:50.020388 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f3694a18-1ab2-4ebe-b1cd-a9236bc5bad9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:50.020912 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f3694a18-1ab2-4ebe-b1cd-a9236bc5bad9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:50.171078 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f3694a18-1ab2-4ebe-b1cd-a9236bc5bad9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:50.179198 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f3694a18-1ab2-4ebe-b1cd-a9236bc5bad9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.176093 Jul 19 20:50:50.179770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 139/251] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:50 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:50.366771 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8918ec1c-93ed-4810-b19b-dc70d0b216d9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:50.369931 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8918ec1c-93ed-4810-b19b-dc70d0b216d9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:50.380343 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8918ec1c-93ed-4810-b19b-dc70d0b216d9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:50.380803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8918ec1c-93ed-4810-b19b-dc70d0b216d9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:50.382241 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8918ec1c-93ed-4810-b19b-dc70d0b216d9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:50.382699 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8918ec1c-93ed-4810-b19b-dc70d0b216d9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:50.383301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:50.423317 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=8 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:50.541104 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8918ec1c-93ed-4810-b19b-dc70d0b216d9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:50.549571 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8918ec1c-93ed-4810-b19b-dc70d0b216d9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1314 microversion: 2.1 time: 0.188344 Jul 19 20:50:50.550149 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 113/252] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:50 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:50.653742 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-926d3e60-4eb0-4b1d-ac5c-4f1774a4184c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:50.654492 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-926d3e60-4eb0-4b1d-ac5c-4f1774a4184c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:50.658465 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=12 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:50.665245 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-926d3e60-4eb0-4b1d-ac5c-4f1774a4184c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:50.665710 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-926d3e60-4eb0-4b1d-ac5c-4f1774a4184c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:50.666648 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-926d3e60-4eb0-4b1d-ac5c-4f1774a4184c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:50.667082 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-926d3e60-4eb0-4b1d-ac5c-4f1774a4184c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:50.819746 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-926d3e60-4eb0-4b1d-ac5c-4f1774a4184c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:50.829104 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-926d3e60-4eb0-4b1d-ac5c-4f1774a4184c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.178571 Jul 19 20:50:50.829916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 140/253] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:50 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:51.196423 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-98799970-ff8e-4f88-b5c6-aa4afa4400cc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:51.196700 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-775384632", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:51.197027 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-98799970-ff8e-4f88-b5c6-aa4afa4400cc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:51.206359 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-98799970-ff8e-4f88-b5c6-aa4afa4400cc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:51.206774 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-98799970-ff8e-4f88-b5c6-aa4afa4400cc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:51.207591 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-98799970-ff8e-4f88-b5c6-aa4afa4400cc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:51.208032 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-98799970-ff8e-4f88-b5c6-aa4afa4400cc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:51.259959 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.network.neutron [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] validate_networks() for None {{(pid=129867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:50:51.524619 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-98799970-ff8e-4f88-b5c6-aa4afa4400cc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:51.532434 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-98799970-ff8e-4f88-b5c6-aa4afa4400cc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.339724 Jul 19 20:50:51.533249 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 141/254] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:51 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:51.568109 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-be4b88e5-8052-4a8e-b954-d08a76050819 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:51.568681 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-be4b88e5-8052-4a8e-b954-d08a76050819 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:51.575153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-be4b88e5-8052-4a8e-b954-d08a76050819 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:51.575595 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-be4b88e5-8052-4a8e-b954-d08a76050819 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:51.576361 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-be4b88e5-8052-4a8e-b954-d08a76050819 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:51.576798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-be4b88e5-8052-4a8e-b954-d08a76050819 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:51.624138 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Flavor limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:50:51.624625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Image limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:50:51.625058 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Flavor pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:50:51.626039 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Image pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:50:51.626487 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:50:51.637524 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:51.637895 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:51.638734 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:51.639184 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:51.657781 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Getting quotas for project 5285b463d71240629eb90b5251f4373f. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:50:51.662282 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Getting quotas for user bfc46df6f92c4bc1a81c9f88ca366057 and project 5285b463d71240629eb90b5251f4373f. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:50:51.676004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Going to run 1 instances... {{(pid=129867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:50:51.678353 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:50:51.721518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-be4b88e5-8052-4a8e-b954-d08a76050819 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:51.729110 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4dca27de-86b2-45bb-921d-2665accb40d1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536641 Jul 19 20:50:51.730146 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 114/255] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:50:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:50:51.731744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-be4b88e5-8052-4a8e-b954-d08a76050819 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1314 microversion: 2.1 time: 0.167382 Jul 19 20:50:51.732404 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 142/256] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:51 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:51.740274 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-890c0e39-1809-44a1-a133-65fb5cfbaff9 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:51.740893 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-890c0e39-1809-44a1-a133-65fb5cfbaff9 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:51.798463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-890c0e39-1809-44a1-a133-65fb5cfbaff9 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:51.807125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-890c0e39-1809-44a1-a133-65fb5cfbaff9 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1214 microversion: 2.1 time: 0.070704 Jul 19 20:50:51.807709 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 115/257] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:51 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:51.854643 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4021aa03-0a88-4b1c-b222-771ec6eee2d4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:51.855349 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4021aa03-0a88-4b1c-b222-771ec6eee2d4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:51.862526 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4021aa03-0a88-4b1c-b222-771ec6eee2d4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:51.863100 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4021aa03-0a88-4b1c-b222-771ec6eee2d4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:51.863898 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4021aa03-0a88-4b1c-b222-771ec6eee2d4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:51.864332 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4021aa03-0a88-4b1c-b222-771ec6eee2d4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:52.013800 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4021aa03-0a88-4b1c-b222-771ec6eee2d4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:52.016275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:52.024054 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4021aa03-0a88-4b1c-b222-771ec6eee2d4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.173607 Jul 19 20:50:52.024703 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 143/258] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:51 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:52.549620 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-daa036cd-0b65-4317-9c0f-9bed63146aae tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:52.550214 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-daa036cd-0b65-4317-9c0f-9bed63146aae tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:52.557731 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-daa036cd-0b65-4317-9c0f-9bed63146aae tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:52.558154 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-daa036cd-0b65-4317-9c0f-9bed63146aae tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:52.558926 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-daa036cd-0b65-4317-9c0f-9bed63146aae tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:52.559357 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-daa036cd-0b65-4317-9c0f-9bed63146aae tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:52.692356 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-daa036cd-0b65-4317-9c0f-9bed63146aae tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:52.699838 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-daa036cd-0b65-4317-9c0f-9bed63146aae tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.154064 Jul 19 20:50:52.700406 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 116/259] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:52 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:52.749861 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5e9596de-bf7c-46a2-82e0-1525cde11c2a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:52.750944 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5e9596de-bf7c-46a2-82e0-1525cde11c2a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:52.757577 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5e9596de-bf7c-46a2-82e0-1525cde11c2a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:52.758064 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5e9596de-bf7c-46a2-82e0-1525cde11c2a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:52.758778 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5e9596de-bf7c-46a2-82e0-1525cde11c2a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:52.759208 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5e9596de-bf7c-46a2-82e0-1525cde11c2a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:52.824367 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-012d557f-ebc6-45c1-8df1-956634d5dee6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:52.825088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-012d557f-ebc6-45c1-8df1-956634d5dee6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:52.831998 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-012d557f-ebc6-45c1-8df1-956634d5dee6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:52.832456 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-012d557f-ebc6-45c1-8df1-956634d5dee6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:52.833247 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-012d557f-ebc6-45c1-8df1-956634d5dee6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:52.833731 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-012d557f-ebc6-45c1-8df1-956634d5dee6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:52.903134 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-012d557f-ebc6-45c1-8df1-956634d5dee6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:52.910586 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-012d557f-ebc6-45c1-8df1-956634d5dee6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1218 microversion: 2.1 time: 0.090352 Jul 19 20:50:52.911174 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 117/260] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:52 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:52.919067 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5e9596de-bf7c-46a2-82e0-1525cde11c2a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:52.927093 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5e9596de-bf7c-46a2-82e0-1525cde11c2a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1314 microversion: 2.1 time: 0.181555 Jul 19 20:50:52.927666 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 144/261] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:52 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:53.041931 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e5c3ddb6-69e6-427e-b2b5-334cc9c3679d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:53.042538 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e5c3ddb6-69e6-427e-b2b5-334cc9c3679d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:53.049122 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e5c3ddb6-69e6-427e-b2b5-334cc9c3679d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:53.049596 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e5c3ddb6-69e6-427e-b2b5-334cc9c3679d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:53.050375 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e5c3ddb6-69e6-427e-b2b5-334cc9c3679d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:53.050803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e5c3ddb6-69e6-427e-b2b5-334cc9c3679d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:53.067097 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=100 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:53.183655 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e5c3ddb6-69e6-427e-b2b5-334cc9c3679d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:53.191786 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e5c3ddb6-69e6-427e-b2b5-334cc9c3679d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.153736 Jul 19 20:50:53.192355 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 118/262] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:53 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:53.440030 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-38f84c34-efc1-448e-b77d-3e11a5382be4 req-b9fbe8d4-55f8-45f4-94ec-475936a6c251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c312c637-f13f-4bf4-a188-154c94f925a3", "name": "network-vif-plugged", "status": "completed", "tag": "4b6a555d-5cef-44f1-ad60-ba83296ef946"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:53.448637 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-38f84c34-efc1-448e-b77d-3e11a5382be4 req-b9fbe8d4-55f8-45f4-94ec-475936a6c251 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:53.449069 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-38f84c34-efc1-448e-b77d-3e11a5382be4 req-b9fbe8d4-55f8-45f4-94ec-475936a6c251 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:53.460638 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-38f84c34-efc1-448e-b77d-3e11a5382be4 req-b9fbe8d4-55f8-45f4-94ec-475936a6c251 service nova] Creating event network-vif-plugged:4b6a555d-5cef-44f1-ad60-ba83296ef946 for instance c312c637-f13f-4bf4-a188-154c94f925a3 on hv-cinder-79987 Jul 19 20:50:53.465641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-38f84c34-efc1-448e-b77d-3e11a5382be4 req-b9fbe8d4-55f8-45f4-94ec-475936a6c251 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029331 Jul 19 20:50:53.466227 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 145/263] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:53.717747 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f4ccfb4f-9fee-4f63-b32a-99d33f996580 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:53.718347 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f4ccfb4f-9fee-4f63-b32a-99d33f996580 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:53.725539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f4ccfb4f-9fee-4f63-b32a-99d33f996580 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:53.725981 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f4ccfb4f-9fee-4f63-b32a-99d33f996580 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:53.726780 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f4ccfb4f-9fee-4f63-b32a-99d33f996580 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:53.727160 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f4ccfb4f-9fee-4f63-b32a-99d33f996580 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:53.872819 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f4ccfb4f-9fee-4f63-b32a-99d33f996580 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:53.880943 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f4ccfb4f-9fee-4f63-b32a-99d33f996580 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.166962 Jul 19 20:50:53.881494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 119/264] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:53 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:53.927916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-da9c46bc-0538-4ba9-9b9d-bfb4adf5ef69 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:53.928608 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-da9c46bc-0538-4ba9-9b9d-bfb4adf5ef69 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:53.934854 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-da9c46bc-0538-4ba9-9b9d-bfb4adf5ef69 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:53.935314 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-da9c46bc-0538-4ba9-9b9d-bfb4adf5ef69 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:53.936075 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-da9c46bc-0538-4ba9-9b9d-bfb4adf5ef69 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:53.936514 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-da9c46bc-0538-4ba9-9b9d-bfb4adf5ef69 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:53.944003 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2b087dba-9e99-44be-9c74-034e178be16c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:53.944562 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2b087dba-9e99-44be-9c74-034e178be16c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:53.950769 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2b087dba-9e99-44be-9c74-034e178be16c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:53.952028 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2b087dba-9e99-44be-9c74-034e178be16c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:53.952411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2b087dba-9e99-44be-9c74-034e178be16c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:53.952815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2b087dba-9e99-44be-9c74-034e178be16c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:54.009781 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-da9c46bc-0538-4ba9-9b9d-bfb4adf5ef69 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:54.018101 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-da9c46bc-0538-4ba9-9b9d-bfb4adf5ef69 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1218 microversion: 2.1 time: 0.094367 Jul 19 20:50:54.021420 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 146/265] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:53 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:54.099189 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2b087dba-9e99-44be-9c74-034e178be16c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:54.107611 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2b087dba-9e99-44be-9c74-034e178be16c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1314 microversion: 2.1 time: 0.167466 Jul 19 20:50:54.108205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 120/266] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:53 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:54.208843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-408fda65-200f-47c1-b8e6-d6e8e662dc54 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:54.209382 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-408fda65-200f-47c1-b8e6-d6e8e662dc54 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:54.215436 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-408fda65-200f-47c1-b8e6-d6e8e662dc54 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:54.215891 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-408fda65-200f-47c1-b8e6-d6e8e662dc54 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:54.216654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-408fda65-200f-47c1-b8e6-d6e8e662dc54 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:54.217097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-408fda65-200f-47c1-b8e6-d6e8e662dc54 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:54.348626 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-408fda65-200f-47c1-b8e6-d6e8e662dc54 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:54.356168 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-408fda65-200f-47c1-b8e6-d6e8e662dc54 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.151292 Jul 19 20:50:54.356806 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 147/267] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:54 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:54.899826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a440dfab-54ee-4c2d-b2a7-c766b4f04376 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:54.900425 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a440dfab-54ee-4c2d-b2a7-c766b4f04376 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:54.907563 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a440dfab-54ee-4c2d-b2a7-c766b4f04376 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:54.908003 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a440dfab-54ee-4c2d-b2a7-c766b4f04376 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:54.908765 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a440dfab-54ee-4c2d-b2a7-c766b4f04376 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:54.909267 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a440dfab-54ee-4c2d-b2a7-c766b4f04376 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:55.035363 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-aa8f3336-8d64-46e0-881d-7c2e46dc0c79 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:55.036506 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-aa8f3336-8d64-46e0-881d-7c2e46dc0c79 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:55.043447 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aa8f3336-8d64-46e0-881d-7c2e46dc0c79 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:55.043813 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aa8f3336-8d64-46e0-881d-7c2e46dc0c79 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:55.044594 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aa8f3336-8d64-46e0-881d-7c2e46dc0c79 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:55.045037 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aa8f3336-8d64-46e0-881d-7c2e46dc0c79 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:55.046307 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a440dfab-54ee-4c2d-b2a7-c766b4f04376 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:55.054714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a440dfab-54ee-4c2d-b2a7-c766b4f04376 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.158722 Jul 19 20:50:55.055299 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 121/268] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:54 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:55.110432 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-aa8f3336-8d64-46e0-881d-7c2e46dc0c79 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:55.117946 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-aa8f3336-8d64-46e0-881d-7c2e46dc0c79 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1266 microversion: 2.1 time: 0.086920 Jul 19 20:50:55.118504 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 148/269] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:55 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:55.125983 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-22005e9e-103a-4a1b-bdd0-e245cfdd28af tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:55.126582 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-22005e9e-103a-4a1b-bdd0-e245cfdd28af tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:55.132762 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-22005e9e-103a-4a1b-bdd0-e245cfdd28af tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:55.133206 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-22005e9e-103a-4a1b-bdd0-e245cfdd28af tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:55.133996 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-22005e9e-103a-4a1b-bdd0-e245cfdd28af tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:55.134453 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-22005e9e-103a-4a1b-bdd0-e245cfdd28af tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:55.267388 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-22005e9e-103a-4a1b-bdd0-e245cfdd28af tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:55.274863 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-22005e9e-103a-4a1b-bdd0-e245cfdd28af tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1314 microversion: 2.1 time: 0.153076 Jul 19 20:50:55.275439 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 122/270] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:55 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:55.374635 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-48480408-b9f1-48db-a0a0-bcd0f4395a84 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:55.375474 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-48480408-b9f1-48db-a0a0-bcd0f4395a84 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:55.382882 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-48480408-b9f1-48db-a0a0-bcd0f4395a84 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:55.383331 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-48480408-b9f1-48db-a0a0-bcd0f4395a84 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:55.384135 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-48480408-b9f1-48db-a0a0-bcd0f4395a84 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:55.384688 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-48480408-b9f1-48db-a0a0-bcd0f4395a84 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:55.523640 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-48480408-b9f1-48db-a0a0-bcd0f4395a84 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:55.534695 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-48480408-b9f1-48db-a0a0-bcd0f4395a84 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.163850 Jul 19 20:50:55.540864 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 149/271] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:55 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:56.071547 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-500543b7-b704-4903-9ef9-40f4e408acd0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:56.072182 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-500543b7-b704-4903-9ef9-40f4e408acd0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:56.079053 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-500543b7-b704-4903-9ef9-40f4e408acd0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:56.079500 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-500543b7-b704-4903-9ef9-40f4e408acd0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:56.080277 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-500543b7-b704-4903-9ef9-40f4e408acd0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:56.080745 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-500543b7-b704-4903-9ef9-40f4e408acd0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:56.135181 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ba3f82a0-5e28-41ea-a97e-685057b935e1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:56.135741 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ba3f82a0-5e28-41ea-a97e-685057b935e1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:56.142196 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ba3f82a0-5e28-41ea-a97e-685057b935e1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:56.142680 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ba3f82a0-5e28-41ea-a97e-685057b935e1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:56.143474 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ba3f82a0-5e28-41ea-a97e-685057b935e1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:56.143916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ba3f82a0-5e28-41ea-a97e-685057b935e1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:56.220642 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ba3f82a0-5e28-41ea-a97e-685057b935e1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:56.228635 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ba3f82a0-5e28-41ea-a97e-685057b935e1 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1272 microversion: 2.1 time: 0.097736 Jul 19 20:50:56.229694 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 150/272] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:56 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:56.250031 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-500543b7-b704-4903-9ef9-40f4e408acd0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:56.258501 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-500543b7-b704-4903-9ef9-40f4e408acd0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.190761 Jul 19 20:50:56.259095 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 123/273] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:56 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:56.292071 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4ca1a6d4-bf68-48f8-8d0a-e9fc96b881c3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:56.292682 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4ca1a6d4-bf68-48f8-8d0a-e9fc96b881c3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:56.299278 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4ca1a6d4-bf68-48f8-8d0a-e9fc96b881c3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:56.299824 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4ca1a6d4-bf68-48f8-8d0a-e9fc96b881c3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:56.300766 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4ca1a6d4-bf68-48f8-8d0a-e9fc96b881c3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:56.301202 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4ca1a6d4-bf68-48f8-8d0a-e9fc96b881c3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:56.432677 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4ca1a6d4-bf68-48f8-8d0a-e9fc96b881c3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:56.440187 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4ca1a6d4-bf68-48f8-8d0a-e9fc96b881c3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1314 microversion: 2.1 time: 0.152058 Jul 19 20:50:56.440753 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 151/274] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:56 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:56.552639 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-714a0bfc-2ec5-43ad-8295-0c5e3c486945 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:56.553243 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-714a0bfc-2ec5-43ad-8295-0c5e3c486945 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:56.559449 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-714a0bfc-2ec5-43ad-8295-0c5e3c486945 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:56.559909 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-714a0bfc-2ec5-43ad-8295-0c5e3c486945 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:56.560669 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-714a0bfc-2ec5-43ad-8295-0c5e3c486945 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:56.561110 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-714a0bfc-2ec5-43ad-8295-0c5e3c486945 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:56.696287 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-714a0bfc-2ec5-43ad-8295-0c5e3c486945 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:56.704683 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-714a0bfc-2ec5-43ad-8295-0c5e3c486945 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.155950 Jul 19 20:50:56.705698 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 124/275] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:56 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:57.246674 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b8965aef-c770-4fc8-8fe3-232a974dd0a0 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:57.247277 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b8965aef-c770-4fc8-8fe3-232a974dd0a0 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:57.254889 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b8965aef-c770-4fc8-8fe3-232a974dd0a0 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:57.255735 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b8965aef-c770-4fc8-8fe3-232a974dd0a0 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:57.256751 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b8965aef-c770-4fc8-8fe3-232a974dd0a0 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:57.257588 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b8965aef-c770-4fc8-8fe3-232a974dd0a0 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:57.275356 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-44aa5d16-9d9b-4c9f-b852-f9b74e9b829e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:57.275956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-44aa5d16-9d9b-4c9f-b852-f9b74e9b829e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:57.291971 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-44aa5d16-9d9b-4c9f-b852-f9b74e9b829e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:57.292431 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-44aa5d16-9d9b-4c9f-b852-f9b74e9b829e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:57.293238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-44aa5d16-9d9b-4c9f-b852-f9b74e9b829e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:57.293702 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-44aa5d16-9d9b-4c9f-b852-f9b74e9b829e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:57.459231 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-44aa5d16-9d9b-4c9f-b852-f9b74e9b829e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:57.467271 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-44aa5d16-9d9b-4c9f-b852-f9b74e9b829e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.195868 Jul 19 20:50:57.468181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 125/276] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:57 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:57.474046 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-46cdeeba-3d33-4e31-aca2-4ced1afb0cb7 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:57.475018 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-46cdeeba-3d33-4e31-aca2-4ced1afb0cb7 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:57.481609 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-46cdeeba-3d33-4e31-aca2-4ced1afb0cb7 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:57.482064 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-46cdeeba-3d33-4e31-aca2-4ced1afb0cb7 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:57.482837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-46cdeeba-3d33-4e31-aca2-4ced1afb0cb7 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:57.483277 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-46cdeeba-3d33-4e31-aca2-4ced1afb0cb7 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:57.581849 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b8965aef-c770-4fc8-8fe3-232a974dd0a0 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:57.602283 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b8965aef-c770-4fc8-8fe3-232a974dd0a0 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.359363 Jul 19 20:50:57.611700 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 152/277] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:57 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:57.723371 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a0fbfd40-b383-4777-90f8-d460bb8e2468 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:57.724402 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a0fbfd40-b383-4777-90f8-d460bb8e2468 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:57.731278 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a0fbfd40-b383-4777-90f8-d460bb8e2468 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:57.731725 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a0fbfd40-b383-4777-90f8-d460bb8e2468 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:57.732492 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a0fbfd40-b383-4777-90f8-d460bb8e2468 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:57.732927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a0fbfd40-b383-4777-90f8-d460bb8e2468 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:57.771106 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-46cdeeba-3d33-4e31-aca2-4ced1afb0cb7 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:57.779755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-46cdeeba-3d33-4e31-aca2-4ced1afb0cb7 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1499 microversion: 2.1 time: 0.309365 Jul 19 20:50:57.780582 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 126/278] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:57 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1499 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:57.933495 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-a0fbfd40-b383-4777-90f8-d460bb8e2468 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:57.942338 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a0fbfd40-b383-4777-90f8-d460bb8e2468 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.224102 Jul 19 20:50:57.951522 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 153/279] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:57 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:58.206340 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-cddf8573-4bd4-4083-93d6-1da02bff9d68 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:58.206846 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-cddf8573-4bd4-4083-93d6-1da02bff9d68 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:58.213270 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cddf8573-4bd4-4083-93d6-1da02bff9d68 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.213810 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cddf8573-4bd4-4083-93d6-1da02bff9d68 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.214587 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cddf8573-4bd4-4083-93d6-1da02bff9d68 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.215028 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cddf8573-4bd4-4083-93d6-1da02bff9d68 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.241716 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-cddf8573-4bd4-4083-93d6-1da02bff9d68 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:50:58.242957 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-a2868aaf-3d57-445b-9285-1e2ca459edc5 req-0983c533-93e3-4de1-87f0-59afef774de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44e702b-f4f1-46e4-8552-a9440c7b13db", "name": "network-vif-plugged", "status": "completed", "tag": "5659d43b-6dee-4967-bcd6-71cb55872ddb"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:58.253352 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-a2868aaf-3d57-445b-9285-1e2ca459edc5 req-0983c533-93e3-4de1-87f0-59afef774de8 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.253978 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-a2868aaf-3d57-445b-9285-1e2ca459edc5 req-0983c533-93e3-4de1-87f0-59afef774de8 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.267624 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-a2868aaf-3d57-445b-9285-1e2ca459edc5 req-0983c533-93e3-4de1-87f0-59afef774de8 service nova] Creating event network-vif-plugged:5659d43b-6dee-4967-bcd6-71cb55872ddb for instance c44e702b-f4f1-46e4-8552-a9440c7b13db on hv-cinder-79987 Jul 19 20:50:58.273467 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-a2868aaf-3d57-445b-9285-1e2ca459edc5 req-0983c533-93e3-4de1-87f0-59afef774de8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035097 Jul 19 20:50:58.274371 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 154/280] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:50:58.338768 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:58.357892 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-cddf8573-4bd4-4083-93d6-1da02bff9d68 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 204 len: 0 microversion: 2.1 time: 0.156080 Jul 19 20:50:58.358489 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 127/281] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:50:58 2022] DELETE /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:50:58.367714 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-fb1bdee8-8b2c-45dc-a13c-bf0e741d4bd8 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:58.368416 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-fb1bdee8-8b2c-45dc-a13c-bf0e741d4bd8 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:58.375768 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb1bdee8-8b2c-45dc-a13c-bf0e741d4bd8 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.376188 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb1bdee8-8b2c-45dc-a13c-bf0e741d4bd8 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.376967 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb1bdee8-8b2c-45dc-a13c-bf0e741d4bd8 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.377438 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb1bdee8-8b2c-45dc-a13c-bf0e741d4bd8 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.488095 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5dfc3a8b-b6a2-487d-bf07-67cb3beead3f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:58.489170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5dfc3a8b-b6a2-487d-bf07-67cb3beead3f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:58.497281 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5dfc3a8b-b6a2-487d-bf07-67cb3beead3f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.498981 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5dfc3a8b-b6a2-487d-bf07-67cb3beead3f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.501540 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5dfc3a8b-b6a2-487d-bf07-67cb3beead3f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.502589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5dfc3a8b-b6a2-487d-bf07-67cb3beead3f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.537235 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-fb1bdee8-8b2c-45dc-a13c-bf0e741d4bd8 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:58.554913 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-fb1bdee8-8b2c-45dc-a13c-bf0e741d4bd8 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1505 microversion: 2.1 time: 0.190789 Jul 19 20:50:58.556189 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 155/282] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:58 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:58.619906 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-73f1c701-4c14-4211-9567-aaf7a383b5d2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:58.620812 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-73f1c701-4c14-4211-9567-aaf7a383b5d2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:58.627793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-73f1c701-4c14-4211-9567-aaf7a383b5d2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.628397 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-73f1c701-4c14-4211-9567-aaf7a383b5d2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.629276 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-73f1c701-4c14-4211-9567-aaf7a383b5d2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.629846 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-73f1c701-4c14-4211-9567-aaf7a383b5d2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.652086 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5dfc3a8b-b6a2-487d-bf07-67cb3beead3f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:58.664167 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5dfc3a8b-b6a2-487d-bf07-67cb3beead3f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.181942 Jul 19 20:50:58.664902 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 128/283] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:58 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:58.769275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-73f1c701-4c14-4211-9567-aaf7a383b5d2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:58.776766 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-73f1c701-4c14-4211-9567-aaf7a383b5d2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.160701 Jul 19 20:50:58.777337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 156/284] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:58 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:58.960366 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-da34ec6f-8151-4546-8f78-4791a7d5af2e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:58.960829 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-da34ec6f-8151-4546-8f78-4791a7d5af2e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:58.967780 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-da34ec6f-8151-4546-8f78-4791a7d5af2e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.968238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-da34ec6f-8151-4546-8f78-4791a7d5af2e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:58.969863 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-da34ec6f-8151-4546-8f78-4791a7d5af2e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:58.970489 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-da34ec6f-8151-4546-8f78-4791a7d5af2e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:59.123647 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-5af369eb-3877-4ba3-bec0-4fcfa3f2152b req-f126aa13-8bc5-45a2-8dd3-8e031c7c1f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2962f7-f6f6-4084-8568-9885f6b05892", "tag": "fbd23da3-8a4b-4932-ae42-f3830da909f8"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:50:59.134513 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-5af369eb-3877-4ba3-bec0-4fcfa3f2152b req-f126aa13-8bc5-45a2-8dd3-8e031c7c1f4e service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:59.135241 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-5af369eb-3877-4ba3-bec0-4fcfa3f2152b req-f126aa13-8bc5-45a2-8dd3-8e031c7c1f4e service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:59.146843 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-da34ec6f-8151-4546-8f78-4791a7d5af2e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:59.151460 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-5af369eb-3877-4ba3-bec0-4fcfa3f2152b req-f126aa13-8bc5-45a2-8dd3-8e031c7c1f4e service nova] Creating event network-changed:fbd23da3-8a4b-4932-ae42-f3830da909f8 for instance 6e2962f7-f6f6-4084-8568-9885f6b05892 on hv-cinder-79987 Jul 19 20:50:59.155581 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-da34ec6f-8151-4546-8f78-4791a7d5af2e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.199584 Jul 19 20:50:59.157989 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-5af369eb-3877-4ba3-bec0-4fcfa3f2152b req-f126aa13-8bc5-45a2-8dd3-8e031c7c1f4e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038661 Jul 19 20:50:59.158240 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 129/285] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:58 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:59.159444 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 157/286] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:50:59.573465 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-12066b74-97ef-44ff-9f90-9cd0316df3b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:59.574070 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-12066b74-97ef-44ff-9f90-9cd0316df3b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:59.580783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-12066b74-97ef-44ff-9f90-9cd0316df3b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:59.581231 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-12066b74-97ef-44ff-9f90-9cd0316df3b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:59.582031 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-12066b74-97ef-44ff-9f90-9cd0316df3b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:59.582469 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-12066b74-97ef-44ff-9f90-9cd0316df3b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:59.683253 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-aac7703b-f6d4-4bb1-b183-89031e85310c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:59.684152 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-aac7703b-f6d4-4bb1-b183-89031e85310c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:59.697866 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aac7703b-f6d4-4bb1-b183-89031e85310c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:59.698323 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aac7703b-f6d4-4bb1-b183-89031e85310c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:59.699113 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aac7703b-f6d4-4bb1-b183-89031e85310c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:59.699581 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aac7703b-f6d4-4bb1-b183-89031e85310c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:59.726282 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-12066b74-97ef-44ff-9f90-9cd0316df3b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:59.733796 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-12066b74-97ef-44ff-9f90-9cd0316df3b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1505 microversion: 2.1 time: 0.164203 Jul 19 20:50:59.734371 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 130/287] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:59 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:50:59.794171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2f94e508-2e4a-4f0e-8a89-a670924a8c7c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:50:59.794785 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2f94e508-2e4a-4f0e-8a89-a670924a8c7c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:50:59.801056 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2f94e508-2e4a-4f0e-8a89-a670924a8c7c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:59.801555 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2f94e508-2e4a-4f0e-8a89-a670924a8c7c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:59.802349 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2f94e508-2e4a-4f0e-8a89-a670924a8c7c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:50:59.802794 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2f94e508-2e4a-4f0e-8a89-a670924a8c7c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:50:59.833736 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-aac7703b-f6d4-4bb1-b183-89031e85310c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:59.841633 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-aac7703b-f6d4-4bb1-b183-89031e85310c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.163395 Jul 19 20:50:59.842209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 158/288] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:59 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:50:59.935160 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2f94e508-2e4a-4f0e-8a89-a670924a8c7c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:50:59.942758 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2f94e508-2e4a-4f0e-8a89-a670924a8c7c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.152480 Jul 19 20:50:59.943348 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 131/289] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:50:59 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:00.173157 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0b49379c-d1c8-4c53-9aa1-8165fa032eb7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:00.173803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0b49379c-d1c8-4c53-9aa1-8165fa032eb7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:00.176074 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:00.181371 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0b49379c-d1c8-4c53-9aa1-8165fa032eb7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:00.181845 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0b49379c-d1c8-4c53-9aa1-8165fa032eb7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:00.182614 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0b49379c-d1c8-4c53-9aa1-8165fa032eb7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:00.183049 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0b49379c-d1c8-4c53-9aa1-8165fa032eb7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:00.319928 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0b49379c-d1c8-4c53-9aa1-8165fa032eb7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:00.327516 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0b49379c-d1c8-4c53-9aa1-8165fa032eb7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.158329 Jul 19 20:51:00.328080 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 159/290] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:00 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:00.751428 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ee7772c8-6138-4151-bcd3-7a98db826074 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:00.752087 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ee7772c8-6138-4151-bcd3-7a98db826074 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:00.759293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ee7772c8-6138-4151-bcd3-7a98db826074 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:00.759744 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ee7772c8-6138-4151-bcd3-7a98db826074 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:00.760530 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ee7772c8-6138-4151-bcd3-7a98db826074 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:00.760974 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ee7772c8-6138-4151-bcd3-7a98db826074 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:00.860836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-62b40f26-8f87-4c87-b2de-c0c0eb3f3b7d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:00.861507 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-62b40f26-8f87-4c87-b2de-c0c0eb3f3b7d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:00.870408 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-62b40f26-8f87-4c87-b2de-c0c0eb3f3b7d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:00.871119 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-62b40f26-8f87-4c87-b2de-c0c0eb3f3b7d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:00.872538 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-62b40f26-8f87-4c87-b2de-c0c0eb3f3b7d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:00.872972 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-62b40f26-8f87-4c87-b2de-c0c0eb3f3b7d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:00.903977 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ee7772c8-6138-4151-bcd3-7a98db826074 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:00.913467 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ee7772c8-6138-4151-bcd3-7a98db826074 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1505 microversion: 2.1 time: 0.166402 Jul 19 20:51:00.914066 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 132/291] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:00 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:00.961121 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b4e89ba8-4f63-42f7-b776-53d2248118d9 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:00.962016 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b4e89ba8-4f63-42f7-b776-53d2248118d9 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:00.969813 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b4e89ba8-4f63-42f7-b776-53d2248118d9 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:00.970309 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b4e89ba8-4f63-42f7-b776-53d2248118d9 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:00.971107 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b4e89ba8-4f63-42f7-b776-53d2248118d9 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:00.971549 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b4e89ba8-4f63-42f7-b776-53d2248118d9 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:00.992257 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:01.079664 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-62b40f26-8f87-4c87-b2de-c0c0eb3f3b7d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:01.091339 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-62b40f26-8f87-4c87-b2de-c0c0eb3f3b7d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.234907 Jul 19 20:51:01.092089 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 160/292] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:00 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:01.165403 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b4e89ba8-4f63-42f7-b776-53d2248118d9 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:01.174360 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b4e89ba8-4f63-42f7-b776-53d2248118d9 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.218024 Jul 19 20:51:01.181424 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 133/293] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:00 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:01.184397 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-6f5dcd0e-5707-415b-b2cb-1cf1ede69651 req-6c78b3a8-f966-46b2-882c-fc19a512b5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c312c637-f13f-4bf4-a188-154c94f925a3", "name": "network-vif-deleted", "tag": "4b6a555d-5cef-44f1-ad60-ba83296ef946"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:01.196758 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-6f5dcd0e-5707-415b-b2cb-1cf1ede69651 req-6c78b3a8-f966-46b2-882c-fc19a512b5a5 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:01.197709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-6f5dcd0e-5707-415b-b2cb-1cf1ede69651 req-6c78b3a8-f966-46b2-882c-fc19a512b5a5 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:01.210647 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-6f5dcd0e-5707-415b-b2cb-1cf1ede69651 req-6c78b3a8-f966-46b2-882c-fc19a512b5a5 service nova] Creating event network-vif-deleted:4b6a555d-5cef-44f1-ad60-ba83296ef946 for instance c312c637-f13f-4bf4-a188-154c94f925a3 on hv-cinder-79987 Jul 19 20:51:01.218949 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-6f5dcd0e-5707-415b-b2cb-1cf1ede69651 req-6c78b3a8-f966-46b2-882c-fc19a512b5a5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043590 Jul 19 20:51:01.219796 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 161/294] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:01.345870 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-36f2bea1-6289-402a-a5b9-36184771cf31 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:01.346468 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-36f2bea1-6289-402a-a5b9-36184771cf31 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:01.352626 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-36f2bea1-6289-402a-a5b9-36184771cf31 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:01.353068 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-36f2bea1-6289-402a-a5b9-36184771cf31 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:01.353858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-36f2bea1-6289-402a-a5b9-36184771cf31 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:01.354287 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-36f2bea1-6289-402a-a5b9-36184771cf31 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:01.488994 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-36f2bea1-6289-402a-a5b9-36184771cf31 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:01.496631 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-36f2bea1-6289-402a-a5b9-36184771cf31 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.155041 Jul 19 20:51:01.497199 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 134/295] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:01 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:01.934011 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2c8d3ed2-dde3-439c-a681-4f63f5ce1a63 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:01.934747 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2c8d3ed2-dde3-439c-a681-4f63f5ce1a63 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:01.941760 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2c8d3ed2-dde3-439c-a681-4f63f5ce1a63 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:01.942213 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2c8d3ed2-dde3-439c-a681-4f63f5ce1a63 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:01.943053 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2c8d3ed2-dde3-439c-a681-4f63f5ce1a63 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:01.943497 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2c8d3ed2-dde3-439c-a681-4f63f5ce1a63 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:02.011044 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2c8d3ed2-dde3-439c-a681-4f63f5ce1a63 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:02.019186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2c8d3ed2-dde3-439c-a681-4f63f5ce1a63 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1299 microversion: 2.1 time: 0.091427 Jul 19 20:51:02.019820 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 162/296] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:01 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:02.120411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0937e6e7-14a0-4505-b369-0edc2f4af5e8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:02.121164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0937e6e7-14a0-4505-b369-0edc2f4af5e8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:02.123403 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:02.124785 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=8 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:02.131213 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0937e6e7-14a0-4505-b369-0edc2f4af5e8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:02.131669 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0937e6e7-14a0-4505-b369-0edc2f4af5e8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:02.132445 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0937e6e7-14a0-4505-b369-0edc2f4af5e8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:02.132885 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0937e6e7-14a0-4505-b369-0edc2f4af5e8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:02.200104 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2bd6a696-b6b0-4e20-9386-c4486df48335 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:02.200706 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2bd6a696-b6b0-4e20-9386-c4486df48335 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:02.207307 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2bd6a696-b6b0-4e20-9386-c4486df48335 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:02.207754 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2bd6a696-b6b0-4e20-9386-c4486df48335 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:02.208524 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2bd6a696-b6b0-4e20-9386-c4486df48335 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:02.208952 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2bd6a696-b6b0-4e20-9386-c4486df48335 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:02.211740 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=100 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:02.289786 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0937e6e7-14a0-4505-b369-0edc2f4af5e8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:02.298052 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0937e6e7-14a0-4505-b369-0edc2f4af5e8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.181799 Jul 19 20:51:02.298633 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 135/297] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:02 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:02.514425 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-46875553-a0e4-4b1f-b175-205807248101 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:02.515025 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-46875553-a0e4-4b1f-b175-205807248101 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:02.522267 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-46875553-a0e4-4b1f-b175-205807248101 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:02.522722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-46875553-a0e4-4b1f-b175-205807248101 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:02.523508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-46875553-a0e4-4b1f-b175-205807248101 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:02.523943 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-46875553-a0e4-4b1f-b175-205807248101 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:02.539967 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2bd6a696-b6b0-4e20-9386-c4486df48335 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:02.548047 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2bd6a696-b6b0-4e20-9386-c4486df48335 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.351288 Jul 19 20:51:02.548616 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 163/298] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:02 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:02.655208 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-46875553-a0e4-4b1f-b175-205807248101 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:02.663773 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-46875553-a0e4-4b1f-b175-205807248101 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.153223 Jul 19 20:51:02.664359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 136/299] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:02 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:03.037236 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-72ffa69b-c597-498c-a3fb-a8b91e321f96 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:03.037829 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-72ffa69b-c597-498c-a3fb-a8b91e321f96 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:03.044009 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72ffa69b-c597-498c-a3fb-a8b91e321f96 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:03.044461 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72ffa69b-c597-498c-a3fb-a8b91e321f96 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:03.045244 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72ffa69b-c597-498c-a3fb-a8b91e321f96 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:03.045697 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72ffa69b-c597-498c-a3fb-a8b91e321f96 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:03.076781 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72ffa69b-c597-498c-a3fb-a8b91e321f96 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:03.077223 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72ffa69b-c597-498c-a3fb-a8b91e321f96 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:03.077704 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-72ffa69b-c597-498c-a3fb-a8b91e321f96 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lazy-loading 'fault' on Instance uuid c312c637-f13f-4bf4-a188-154c94f925a3 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:51:03.124772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-72ffa69b-c597-498c-a3fb-a8b91e321f96 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:03.132920 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-72ffa69b-c597-498c-a3fb-a8b91e321f96 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1304 microversion: 2.1 time: 0.100552 Jul 19 20:51:03.133714 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 164/300] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:03 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:03.315494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5bba1ef4-c546-40f5-98bd-5cec4bfd42ed tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:03.316093 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5bba1ef4-c546-40f5-98bd-5cec4bfd42ed tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:03.322912 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5bba1ef4-c546-40f5-98bd-5cec4bfd42ed tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:03.323370 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5bba1ef4-c546-40f5-98bd-5cec4bfd42ed tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:03.324144 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5bba1ef4-c546-40f5-98bd-5cec4bfd42ed tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:03.324588 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5bba1ef4-c546-40f5-98bd-5cec4bfd42ed tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:03.460961 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5bba1ef4-c546-40f5-98bd-5cec4bfd42ed tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:03.468549 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5bba1ef4-c546-40f5-98bd-5cec4bfd42ed tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1360 microversion: 2.1 time: 0.157462 Jul 19 20:51:03.469112 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 137/301] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:03 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:03.566811 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-058a72c0-8e8f-4aa3-bb81-b3f0a619e2fd tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:03.567330 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-058a72c0-8e8f-4aa3-bb81-b3f0a619e2fd tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:03.573599 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-058a72c0-8e8f-4aa3-bb81-b3f0a619e2fd tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:03.574058 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-058a72c0-8e8f-4aa3-bb81-b3f0a619e2fd tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:03.574834 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-058a72c0-8e8f-4aa3-bb81-b3f0a619e2fd tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:03.575310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-058a72c0-8e8f-4aa3-bb81-b3f0a619e2fd tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:03.680522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-be74544c-8579-4e6d-b81f-19f3da0261ea tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:03.681123 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-be74544c-8579-4e6d-b81f-19f3da0261ea tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:03.687027 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-be74544c-8579-4e6d-b81f-19f3da0261ea tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:03.687472 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-be74544c-8579-4e6d-b81f-19f3da0261ea tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:03.688877 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-be74544c-8579-4e6d-b81f-19f3da0261ea tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:03.689462 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-be74544c-8579-4e6d-b81f-19f3da0261ea tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:03.704705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-058a72c0-8e8f-4aa3-bb81-b3f0a619e2fd tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:03.712314 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-058a72c0-8e8f-4aa3-bb81-b3f0a619e2fd tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.150045 Jul 19 20:51:03.712878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 165/302] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:03 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:03.826004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-be74544c-8579-4e6d-b81f-19f3da0261ea tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:03.833536 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-be74544c-8579-4e6d-b81f-19f3da0261ea tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.156938 Jul 19 20:51:03.834099 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 138/303] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:03 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:04.154360 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9ec7685f-3436-4dfe-9441-9f312807989e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:04.155078 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-9ec7685f-3436-4dfe-9441-9f312807989e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:04.165382 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9ec7685f-3436-4dfe-9441-9f312807989e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:04.165850 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9ec7685f-3436-4dfe-9441-9f312807989e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:04.167526 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9ec7685f-3436-4dfe-9441-9f312807989e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:04.167970 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9ec7685f-3436-4dfe-9441-9f312807989e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:04.202202 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9ec7685f-3436-4dfe-9441-9f312807989e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:04.202653 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9ec7685f-3436-4dfe-9441-9f312807989e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:04.203125 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-9ec7685f-3436-4dfe-9441-9f312807989e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lazy-loading 'fault' on Instance uuid c312c637-f13f-4bf4-a188-154c94f925a3 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:51:04.245890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9ec7685f-3436-4dfe-9441-9f312807989e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:04.254531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9ec7685f-3436-4dfe-9441-9f312807989e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 200 len: 1304 microversion: 2.1 time: 0.107013 Jul 19 20:51:04.255076 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 166/304] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:04 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:04.486019 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ec57fdac-6842-4f94-acf2-bee2efac0cec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:04.486616 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ec57fdac-6842-4f94-acf2-bee2efac0cec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:04.493108 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ec57fdac-6842-4f94-acf2-bee2efac0cec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:04.493593 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ec57fdac-6842-4f94-acf2-bee2efac0cec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:04.494381 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ec57fdac-6842-4f94-acf2-bee2efac0cec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:04.494800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ec57fdac-6842-4f94-acf2-bee2efac0cec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:04.634300 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ec57fdac-6842-4f94-acf2-bee2efac0cec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:04.642810 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ec57fdac-6842-4f94-acf2-bee2efac0cec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1546 microversion: 2.1 time: 0.161093 Jul 19 20:51:04.643407 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 139/305] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:04 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:04.659478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-fda40d75-60a0-4a0d-862b-9ead32032a05 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:04.659958 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-fda40d75-60a0-4a0d-862b-9ead32032a05 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:04.666592 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fda40d75-60a0-4a0d-862b-9ead32032a05 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:04.667045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fda40d75-60a0-4a0d-862b-9ead32032a05 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:04.667819 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fda40d75-60a0-4a0d-862b-9ead32032a05 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:04.668261 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fda40d75-60a0-4a0d-862b-9ead32032a05 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:04.729609 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-6f1d4bcd-5c8f-405f-a67b-bb0ee80daf8b tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:04.730410 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-6f1d4bcd-5c8f-405f-a67b-bb0ee80daf8b tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:04.737559 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6f1d4bcd-5c8f-405f-a67b-bb0ee80daf8b tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:04.742638 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6f1d4bcd-5c8f-405f-a67b-bb0ee80daf8b tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:04.743483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6f1d4bcd-5c8f-405f-a67b-bb0ee80daf8b tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:04.743934 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6f1d4bcd-5c8f-405f-a67b-bb0ee80daf8b tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:04.759618 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-fda40d75-60a0-4a0d-862b-9ead32032a05 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104524 Jul 19 20:51:04.760232 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 167/306] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jul 19 20:51:04 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:04.851384 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-794eedd2-9ca1-4049-8137-23016c41f69e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:04.852100 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-794eedd2-9ca1-4049-8137-23016c41f69e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:04.858982 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-794eedd2-9ca1-4049-8137-23016c41f69e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:04.859597 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-794eedd2-9ca1-4049-8137-23016c41f69e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:04.860965 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-794eedd2-9ca1-4049-8137-23016c41f69e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:04.861499 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-794eedd2-9ca1-4049-8137-23016c41f69e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:05.201709 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6f1d4bcd-5c8f-405f-a67b-bb0ee80daf8b tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:05.209818 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-6f1d4bcd-5c8f-405f-a67b-bb0ee80daf8b tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.484344 Jul 19 20:51:05.210781 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 140/307] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:04 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:05.271467 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-794eedd2-9ca1-4049-8137-23016c41f69e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:05.275194 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7dbb1261-5784-4506-87df-c204e1e251ee tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:05.276895 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7dbb1261-5784-4506-87df-c204e1e251ee tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: c312c637-f13f-4bf4-a188-154c94f925a3] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:05.281881 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-794eedd2-9ca1-4049-8137-23016c41f69e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.434376 Jul 19 20:51:05.292774 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 168/308] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:04 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:05.294277 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7dbb1261-5784-4506-87df-c204e1e251ee tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:05.294939 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7dbb1261-5784-4506-87df-c204e1e251ee tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:05.296042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7dbb1261-5784-4506-87df-c204e1e251ee tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:05.296375 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7dbb1261-5784-4506-87df-c204e1e251ee tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:05.314546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-7dbb1261-5784-4506-87df-c204e1e251ee tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] HTTP exception thrown: Instance c312c637-f13f-4bf4-a188-154c94f925a3 could not be found. Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7dbb1261-5784-4506-87df-c204e1e251ee tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Request method failure captured: Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 HTTP/1.1 Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xkZ54nb-YyPuOxuz0fnoiDlnQoCAtUGe-fWVDS9GXgAhOlVo3epgeHNQe6aumYt-lq7Q8yKz8cfj4YdoQK0Rg7ULTjdHv06XM0nDVSptpDZPcBGyZxkaEoRdYYtnrA4egRQ-HtOSJ-OmXb5N5Qg86KCTkvOkUK-1tOXb4UtyJ1klDc Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 0bc1c7a8029e4d40ac256dd2f877317b Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-VolumesActionsTest-312434626 Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:51:05.316811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:51:05.318402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0bc1c7a8029e4d40ac256dd2f877317b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bc1c7a8029e4d40ac256dd2f877317b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bc1c7a8029e4d40ac256dd2f877317b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0bc1c7a8029e4d40ac256dd2f877317b", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:51:05.318402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-VolumesActionsTest-312434626 Jul 19 20:51:05.318402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 0bc1c7a8029e4d40ac256dd2f877317b Jul 19 20:51:05.318402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-VolumesActionsTest-312434626 Jul 19 20:51:05.318402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-VolumesActionsTest-312434626-project Jul 19 20:51:05.318402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:51:05.318402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:51:05.318402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: 6f3e4ee4b3ca492cabf2622f0659b5a5 Jul 19 20:51:05.318402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-VolumesActionsTest-312434626-project Jul 19 20:51:05.318402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:51:05.318402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance c312c637-f13f-4bf4-a188-154c94f925a3 could not be found. Jul 19 20:51:05.318402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': 'c312c637-f13f-4bf4-a188-154c94f925a3'} Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c312c637-f13f-4bf4-a188-154c94f925a3 could not be found. Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:51:05.319441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c312c637-f13f-4bf4-a188-154c94f925a3 could not be found. Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c312c637-f13f-4bf4-a188-154c94f925a3 could not be found. Jul 19 20:51:05.320855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:05.322188 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7dbb1261-5784-4506-87df-c204e1e251ee tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Returning 404 to user: Instance c312c637-f13f-4bf4-a188-154c94f925a3 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:51:05.322188 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7dbb1261-5784-4506-87df-c204e1e251ee tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3" status: 404 len: 111 microversion: 2.1 time: 0.049221 Jul 19 20:51:05.322188 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 141/309] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:05 2022] GET /compute/v2.1/servers/c312c637-f13f-4bf4-a188-154c94f925a3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:51:05.485141 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1925833629", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "networks": [{"uuid": "9fe2abf4-f92d-4e59-ac1e-b9cea613fe5d"}]}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:05.540971 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.network.neutron [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] validate_networks() for [('9fe2abf4-f92d-4e59-ac1e-b9cea613fe5d', None, None, None, None, None)] {{(pid=129866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:51:06.228316 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-12cd4313-839a-4555-927e-46131a0b3911 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:06.229085 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-12cd4313-839a-4555-927e-46131a0b3911 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:06.236434 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-12cd4313-839a-4555-927e-46131a0b3911 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:06.236990 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-12cd4313-839a-4555-927e-46131a0b3911 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:06.237897 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-12cd4313-839a-4555-927e-46131a0b3911 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:06.238344 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-12cd4313-839a-4555-927e-46131a0b3911 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:06.515096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Flavor limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:51:06.515618 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Image limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:51:06.516579 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Flavor pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:51:06.517154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Image pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:51:06.518212 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:51:06.528121 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:06.528664 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:06.529712 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:06.530208 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:06.550403 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Getting quotas for project 0bc1c7a8029e4d40ac256dd2f877317b. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:51:06.555256 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Getting quotas for user 6f3e4ee4b3ca492cabf2622f0659b5a5 and project 0bc1c7a8029e4d40ac256dd2f877317b. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:51:06.568210 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-12cd4313-839a-4555-927e-46131a0b3911 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:06.576793 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-12cd4313-839a-4555-927e-46131a0b3911 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.352237 Jul 19 20:51:06.577377 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 142/310] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:06 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:06.584025 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ef784074-3594-407e-a10f-1cfe57d5905a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:06.584858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ef784074-3594-407e-a10f-1cfe57d5905a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:06.587391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Going to run 1 instances... {{(pid=129866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:51:06.589695 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:51:06.606775 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ef784074-3594-407e-a10f-1cfe57d5905a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:06.607245 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ef784074-3594-407e-a10f-1cfe57d5905a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:06.608194 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ef784074-3594-407e-a10f-1cfe57d5905a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:06.608760 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ef784074-3594-407e-a10f-1cfe57d5905a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:06.650630 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-52ddc9ca-291f-4769-8631-5bcde09ba122 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169734 Jul 19 20:51:06.652662 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 169/311] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:51:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:51:06.664086 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-69f73142-5f29-4780-929b-90e92b181ec9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:06.665014 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-69f73142-5f29-4780-929b-90e92b181ec9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:06.773401 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-69f73142-5f29-4780-929b-90e92b181ec9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:06.788333 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-69f73142-5f29-4780-929b-90e92b181ec9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1214 microversion: 2.1 time: 0.129059 Jul 19 20:51:06.793541 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 170/312] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:06 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:06.884700 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ef784074-3594-407e-a10f-1cfe57d5905a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:06.894299 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-d5dc87ef-88d7-4395-bbf8-869e52bf19dd req-51284754-f411-4c1c-9dde-d7ddf5133eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c44e702b-f4f1-46e4-8552-a9440c7b13db", "tag": "5659d43b-6dee-4967-bcd6-71cb55872ddb"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:06.896466 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ef784074-3594-407e-a10f-1cfe57d5905a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.317407 Jul 19 20:51:06.897430 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 143/313] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:06 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:06.905210 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-d5dc87ef-88d7-4395-bbf8-869e52bf19dd req-51284754-f411-4c1c-9dde-d7ddf5133eb7 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:06.905723 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-d5dc87ef-88d7-4395-bbf8-869e52bf19dd req-51284754-f411-4c1c-9dde-d7ddf5133eb7 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:06.921229 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-d5dc87ef-88d7-4395-bbf8-869e52bf19dd req-51284754-f411-4c1c-9dde-d7ddf5133eb7 service nova] Creating event network-changed:5659d43b-6dee-4967-bcd6-71cb55872ddb for instance c44e702b-f4f1-46e4-8552-a9440c7b13db on hv-cinder-79987 Jul 19 20:51:06.927164 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-d5dc87ef-88d7-4395-bbf8-869e52bf19dd req-51284754-f411-4c1c-9dde-d7ddf5133eb7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038607 Jul 19 20:51:06.927988 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 171/314] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:51:07.594537 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-20588a59-c2c9-4cf1-8b2f-6f44b5d7878f tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:07.595507 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-20588a59-c2c9-4cf1-8b2f-6f44b5d7878f tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:07.602118 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-20588a59-c2c9-4cf1-8b2f-6f44b5d7878f tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:07.602550 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-20588a59-c2c9-4cf1-8b2f-6f44b5d7878f tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:07.603320 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-20588a59-c2c9-4cf1-8b2f-6f44b5d7878f tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:07.603755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-20588a59-c2c9-4cf1-8b2f-6f44b5d7878f tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:07.744976 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-20588a59-c2c9-4cf1-8b2f-6f44b5d7878f tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:07.757323 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-20588a59-c2c9-4cf1-8b2f-6f44b5d7878f tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.166775 Jul 19 20:51:07.758255 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 144/315] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:07 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:07.808063 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-fbb25b8d-4053-497f-a91d-9f299cc4e34e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:07.809290 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-fbb25b8d-4053-497f-a91d-9f299cc4e34e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:07.818221 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fbb25b8d-4053-497f-a91d-9f299cc4e34e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:07.819200 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fbb25b8d-4053-497f-a91d-9f299cc4e34e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:07.820792 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fbb25b8d-4053-497f-a91d-9f299cc4e34e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:07.821375 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fbb25b8d-4053-497f-a91d-9f299cc4e34e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:07.894036 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-fbb25b8d-4053-497f-a91d-9f299cc4e34e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:07.903977 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-fbb25b8d-4053-497f-a91d-9f299cc4e34e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1218 microversion: 2.1 time: 0.101471 Jul 19 20:51:07.904801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 172/316] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:07 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:07.914972 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-afb0ba4e-9bac-4e25-a315-f61f41b7cb46 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:07.916100 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-afb0ba4e-9bac-4e25-a315-f61f41b7cb46 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:07.923458 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-afb0ba4e-9bac-4e25-a315-f61f41b7cb46 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:07.924270 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-afb0ba4e-9bac-4e25-a315-f61f41b7cb46 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:07.925203 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-afb0ba4e-9bac-4e25-a315-f61f41b7cb46 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:07.925802 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-afb0ba4e-9bac-4e25-a315-f61f41b7cb46 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:08.085703 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-afb0ba4e-9bac-4e25-a315-f61f41b7cb46 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:08.098540 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-afb0ba4e-9bac-4e25-a315-f61f41b7cb46 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.188254 Jul 19 20:51:08.105702 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 145/317] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:07 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:08.775067 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-85e8ae90-09fc-43ce-b5ab-3442a2523cf2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:08.775705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-85e8ae90-09fc-43ce-b5ab-3442a2523cf2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:08.782086 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-85e8ae90-09fc-43ce-b5ab-3442a2523cf2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:08.782643 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-85e8ae90-09fc-43ce-b5ab-3442a2523cf2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:08.783284 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-85e8ae90-09fc-43ce-b5ab-3442a2523cf2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:08.783720 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-85e8ae90-09fc-43ce-b5ab-3442a2523cf2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:08.925036 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-65d05f3d-f4cd-40df-a47e-2218185344b9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:08.926280 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-65d05f3d-f4cd-40df-a47e-2218185344b9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:08.936298 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-65d05f3d-f4cd-40df-a47e-2218185344b9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:08.936825 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-65d05f3d-f4cd-40df-a47e-2218185344b9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:08.941933 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-85e8ae90-09fc-43ce-b5ab-3442a2523cf2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:08.945652 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-65d05f3d-f4cd-40df-a47e-2218185344b9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:08.946485 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-65d05f3d-f4cd-40df-a47e-2218185344b9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:08.950870 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-85e8ae90-09fc-43ce-b5ab-3442a2523cf2 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.179644 Jul 19 20:51:08.966042 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 173/318] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:08 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:09.032418 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-65d05f3d-f4cd-40df-a47e-2218185344b9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:09.045481 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-65d05f3d-f4cd-40df-a47e-2218185344b9 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1218 microversion: 2.1 time: 0.125971 Jul 19 20:51:09.046562 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 146/319] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:08 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:09.116316 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6e1c2353-f889-46c4-976f-75ad8a6091b6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:09.116923 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6e1c2353-f889-46c4-976f-75ad8a6091b6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:09.123060 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6e1c2353-f889-46c4-976f-75ad8a6091b6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:09.123511 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6e1c2353-f889-46c4-976f-75ad8a6091b6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:09.124282 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6e1c2353-f889-46c4-976f-75ad8a6091b6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:09.124719 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6e1c2353-f889-46c4-976f-75ad8a6091b6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:09.294733 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6e1c2353-f889-46c4-976f-75ad8a6091b6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:09.303367 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6e1c2353-f889-46c4-976f-75ad8a6091b6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.191619 Jul 19 20:51:09.303945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 174/320] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:09 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:09.982479 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-441443ff-c4d5-4616-bf54-a12ffef0190a tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:09.983111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-441443ff-c4d5-4616-bf54-a12ffef0190a tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:09.989765 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-441443ff-c4d5-4616-bf54-a12ffef0190a tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:09.990390 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-441443ff-c4d5-4616-bf54-a12ffef0190a tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:09.990941 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-441443ff-c4d5-4616-bf54-a12ffef0190a tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:09.991407 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-441443ff-c4d5-4616-bf54-a12ffef0190a tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:10.064021 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c28bd018-6398-4906-9e48-5ef01b6ced29 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:10.064619 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c28bd018-6398-4906-9e48-5ef01b6ced29 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:10.070928 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c28bd018-6398-4906-9e48-5ef01b6ced29 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:10.071374 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c28bd018-6398-4906-9e48-5ef01b6ced29 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:10.072137 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c28bd018-6398-4906-9e48-5ef01b6ced29 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:10.072566 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c28bd018-6398-4906-9e48-5ef01b6ced29 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:10.147108 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c28bd018-6398-4906-9e48-5ef01b6ced29 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:10.155020 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c28bd018-6398-4906-9e48-5ef01b6ced29 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1266 microversion: 2.1 time: 0.095303 Jul 19 20:51:10.155592 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 175/321] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:10 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:10.155746 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-441443ff-c4d5-4616-bf54-a12ffef0190a tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:10.167984 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-441443ff-c4d5-4616-bf54-a12ffef0190a tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.189373 Jul 19 20:51:10.168567 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 147/322] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:09 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:10.320578 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-32e74b3f-b817-468e-a8d8-19464ababf74 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:10.321256 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-32e74b3f-b817-468e-a8d8-19464ababf74 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:10.327455 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-32e74b3f-b817-468e-a8d8-19464ababf74 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:10.328183 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-32e74b3f-b817-468e-a8d8-19464ababf74 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:10.329101 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-32e74b3f-b817-468e-a8d8-19464ababf74 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:10.330303 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-32e74b3f-b817-468e-a8d8-19464ababf74 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:10.476615 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-32e74b3f-b817-468e-a8d8-19464ababf74 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:10.486002 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-32e74b3f-b817-468e-a8d8-19464ababf74 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1502 microversion: 2.1 time: 0.169259 Jul 19 20:51:10.486937 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 176/323] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:10 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:10.505636 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0ad1a747-8849-486d-9945-b00362b2ec63 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ea8c83d-a507-4160-8b68-c2166d6dd6c5"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:10.506955 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0ad1a747-8849-486d-9945-b00362b2ec63 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:10.514201 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ad1a747-8849-486d-9945-b00362b2ec63 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:10.514646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ad1a747-8849-486d-9945-b00362b2ec63 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:10.515418 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ad1a747-8849-486d-9945-b00362b2ec63 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:10.515967 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ad1a747-8849-486d-9945-b00362b2ec63 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:10.541251 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-0ad1a747-8849-486d-9945-b00362b2ec63 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] HTTP exception thrown: Cannot 'attach_volume' instance b07400b5-bd6a-4841-a97c-3c7e6704de6a while it is in vm_state rescued Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0ad1a747-8849-486d-9945-b00362b2ec63 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Request method failure captured: Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: POST /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a/os-volume_attachments HTTP/1.1 Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 74 Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjIeNeE6tE-ebPrmYqZLKOkhuEvhTtzR4zG55Oz6qsVbdRt6XJd2QG1rQJo8ir8u5ycQmi1GJQ_v731GDE9SPVFb5LbYPGDcqwGAm-YQz_uafBtTUZcjuOM6phW7UenFGjceuk_FrYndKcIKfU_iLxW2cbkWvBF0_JuN3GJ10NFEiM Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 6cc474e26dd8444b99645279c4d133bf Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:51:10.543021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:51:10.544252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6cc474e26dd8444b99645279c4d133bf", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:51:10.544252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:51:10.544252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 6cc474e26dd8444b99645279c4d133bf Jul 19 20:51:10.544252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:51:10.544252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-ServerRescueNegativeTestJSON-1650342896-project Jul 19 20:51:10.544252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:51:10.544252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:51:10.544252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: 9fa96f51390e46e991c6e9afa385d2f7 Jul 19 20:51:10.544252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1650342896-project Jul 19 20:51:10.544252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Jul 19 20:51:10.544252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {"volumeAttachment": {"volumeId": "9ea8c83d-a507-4160-8b68-c2166d6dd6c5"}} Jul 19 20:51:10.544252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Cannot 'attach_volume' instance b07400b5-bd6a-4841-a97c-3c7e6704de6a while it is in vm_state rescued Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'server_id': 'b07400b5-bd6a-4841-a97c-3c7e6704de6a', 'body': {'volumeAttachment': {'volumeId': '9ea8c83d-a507-4160-8b68-c2166d6dd6c5'}}} Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b07400b5-bd6a-4841-a97c-3c7e6704de6a in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:51:10.545172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b07400b5-bd6a-4841-a97c-3c7e6704de6a while it is in vm_state rescued Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:10.547546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:10.549612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:51:10.549612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:51:10.549612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b07400b5-bd6a-4841-a97c-3c7e6704de6a while it is in vm_state rescued Jul 19 20:51:10.549612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:10.549612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0ad1a747-8849-486d-9945-b00362b2ec63 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Returning 409 to user: Cannot 'attach_volume' instance b07400b5-bd6a-4841-a97c-3c7e6704de6a while it is in vm_state rescued {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:51:10.549612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0ad1a747-8849-486d-9945-b00362b2ec63 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "POST /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044284 Jul 19 20:51:10.549612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 148/324] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 20:51:10 2022] POST /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:51:10.556094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dc28eceb-c6ce-493d-b935-c09b16c19fd6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:10.556631 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-dc28eceb-c6ce-493d-b935-c09b16c19fd6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:10.566857 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dc28eceb-c6ce-493d-b935-c09b16c19fd6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:10.567637 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dc28eceb-c6ce-493d-b935-c09b16c19fd6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:10.569129 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dc28eceb-c6ce-493d-b935-c09b16c19fd6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:10.570049 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dc28eceb-c6ce-493d-b935-c09b16c19fd6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:10.645758 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dc28eceb-c6ce-493d-b935-c09b16c19fd6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "POST /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a/action" status: 202 len: 0 microversion: 2.1 time: 0.093639 Jul 19 20:51:10.646434 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 177/325] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 20:51:10 2022] POST /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:51:10.655333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7ab3c087-295f-43e9-926b-19b6e4f03a21 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:10.655944 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7ab3c087-295f-43e9-926b-19b6e4f03a21 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:10.664174 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7ab3c087-295f-43e9-926b-19b6e4f03a21 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:10.664880 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7ab3c087-295f-43e9-926b-19b6e4f03a21 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:10.666010 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7ab3c087-295f-43e9-926b-19b6e4f03a21 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:10.666632 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7ab3c087-295f-43e9-926b-19b6e4f03a21 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:10.834037 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7ab3c087-295f-43e9-926b-19b6e4f03a21 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:10.843049 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7ab3c087-295f-43e9-926b-19b6e4f03a21 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1510 microversion: 2.1 time: 0.192271 Jul 19 20:51:10.854771 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 149/326] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:10 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:11.176094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7494cd30-b31d-41c3-916e-f62ab708535c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:11.177413 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-7494cd30-b31d-41c3-916e-f62ab708535c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:11.185401 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7494cd30-b31d-41c3-916e-f62ab708535c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:11.185970 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7494cd30-b31d-41c3-916e-f62ab708535c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:11.188471 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7494cd30-b31d-41c3-916e-f62ab708535c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:11.188650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-cbfc99cc-3cb8-44ec-9508-b1c318dd7525 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:11.189109 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-cbfc99cc-3cb8-44ec-9508-b1c318dd7525 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:11.189213 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7494cd30-b31d-41c3-916e-f62ab708535c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:11.196818 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cbfc99cc-3cb8-44ec-9508-b1c318dd7525 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:11.197390 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cbfc99cc-3cb8-44ec-9508-b1c318dd7525 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:11.198272 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cbfc99cc-3cb8-44ec-9508-b1c318dd7525 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:11.198962 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cbfc99cc-3cb8-44ec-9508-b1c318dd7525 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:11.275615 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-7494cd30-b31d-41c3-916e-f62ab708535c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:11.284892 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-7494cd30-b31d-41c3-916e-f62ab708535c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1272 microversion: 2.1 time: 0.115663 Jul 19 20:51:11.285660 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 178/327] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:11 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:11.372880 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-cbfc99cc-3cb8-44ec-9508-b1c318dd7525 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:11.378730 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-cbfc99cc-3cb8-44ec-9508-b1c318dd7525 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.197787 Jul 19 20:51:11.379652 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 150/328] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:11 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:11.862167 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3b6d49aa-6422-4348-b5c7-3af0521c0cbc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:11.862716 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3b6d49aa-6422-4348-b5c7-3af0521c0cbc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:11.869214 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3b6d49aa-6422-4348-b5c7-3af0521c0cbc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:11.869736 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3b6d49aa-6422-4348-b5c7-3af0521c0cbc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:11.870517 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3b6d49aa-6422-4348-b5c7-3af0521c0cbc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:11.870955 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3b6d49aa-6422-4348-b5c7-3af0521c0cbc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:12.018304 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3b6d49aa-6422-4348-b5c7-3af0521c0cbc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:12.026168 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3b6d49aa-6422-4348-b5c7-3af0521c0cbc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1510 microversion: 2.1 time: 0.167958 Jul 19 20:51:12.026767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 179/329] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:11 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:12.295492 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-7447d6ac-8473-4847-b084-0a3f421421b1 req-80cbe524-1c77-40f6-a4bc-37ed22432d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2962f7-f6f6-4084-8568-9885f6b05892", "name": "network-vif-plugged", "status": "completed", "tag": "fbd23da3-8a4b-4932-ae42-f3830da909f8"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:12.310400 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7a5eb409-2c2c-4377-89a0-474c0d6bea1c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:12.311233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-7a5eb409-2c2c-4377-89a0-474c0d6bea1c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:12.311389 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-7447d6ac-8473-4847-b084-0a3f421421b1 req-80cbe524-1c77-40f6-a4bc-37ed22432d73 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:12.311674 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-7447d6ac-8473-4847-b084-0a3f421421b1 req-80cbe524-1c77-40f6-a4bc-37ed22432d73 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:12.316748 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=100 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:12.318518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7a5eb409-2c2c-4377-89a0-474c0d6bea1c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:12.319063 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7a5eb409-2c2c-4377-89a0-474c0d6bea1c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:12.319986 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7a5eb409-2c2c-4377-89a0-474c0d6bea1c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:12.320524 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7a5eb409-2c2c-4377-89a0-474c0d6bea1c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:12.327038 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-7447d6ac-8473-4847-b084-0a3f421421b1 req-80cbe524-1c77-40f6-a4bc-37ed22432d73 service nova] Creating event network-vif-plugged:fbd23da3-8a4b-4932-ae42-f3830da909f8 for instance 6e2962f7-f6f6-4084-8568-9885f6b05892 on hv-cinder-79987 Jul 19 20:51:12.333847 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-7447d6ac-8473-4847-b084-0a3f421421b1 req-80cbe524-1c77-40f6-a4bc-37ed22432d73 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043999 Jul 19 20:51:12.335111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 151/330] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:12.397655 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4fbcb020-1708-4859-bd02-77ab16660dac tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:12.398400 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4fbcb020-1708-4859-bd02-77ab16660dac tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:12.411535 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4fbcb020-1708-4859-bd02-77ab16660dac tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:12.413138 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4fbcb020-1708-4859-bd02-77ab16660dac tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:12.414180 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4fbcb020-1708-4859-bd02-77ab16660dac tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:12.415769 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4fbcb020-1708-4859-bd02-77ab16660dac tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:12.557031 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-7a5eb409-2c2c-4377-89a0-474c0d6bea1c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:12.560979 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:12.570522 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-7a5eb409-2c2c-4377-89a0-474c0d6bea1c tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1314 microversion: 2.1 time: 0.265428 Jul 19 20:51:12.571578 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 180/331] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:12 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:12.598455 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4fbcb020-1708-4859-bd02-77ab16660dac tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:12.606881 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4fbcb020-1708-4859-bd02-77ab16660dac tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.213476 Jul 19 20:51:12.607646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 152/332] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:12 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:12.754613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-0fc0e7a1-5570-4b26-8b25-df39d7334ab1 req-026ef970-6398-4152-a919-2d691a9b252f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8500d09-a98f-4348-bfdf-de65c829dadf", "tag": "5e3cbb90-f209-4384-96d7-fddc117d1772"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:12.764554 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-0fc0e7a1-5570-4b26-8b25-df39d7334ab1 req-026ef970-6398-4152-a919-2d691a9b252f service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:12.765088 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-0fc0e7a1-5570-4b26-8b25-df39d7334ab1 req-026ef970-6398-4152-a919-2d691a9b252f service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:12.776974 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-0fc0e7a1-5570-4b26-8b25-df39d7334ab1 req-026ef970-6398-4152-a919-2d691a9b252f service nova] Creating event network-changed:5e3cbb90-f209-4384-96d7-fddc117d1772 for instance d8500d09-a98f-4348-bfdf-de65c829dadf on hv-cinder-79987 Jul 19 20:51:12.781852 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-0fc0e7a1-5570-4b26-8b25-df39d7334ab1 req-026ef970-6398-4152-a919-2d691a9b252f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031995 Jul 19 20:51:12.782448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 181/333] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:13.044035 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-732cc15a-d1c4-4bc6-9437-01533b1413d5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:13.044672 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-732cc15a-d1c4-4bc6-9437-01533b1413d5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:13.051536 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-732cc15a-d1c4-4bc6-9437-01533b1413d5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:13.051997 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-732cc15a-d1c4-4bc6-9437-01533b1413d5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:13.052771 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-732cc15a-d1c4-4bc6-9437-01533b1413d5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:13.053205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-732cc15a-d1c4-4bc6-9437-01533b1413d5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:13.186847 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-732cc15a-d1c4-4bc6-9437-01533b1413d5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:13.194367 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-732cc15a-d1c4-4bc6-9437-01533b1413d5 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1510 microversion: 2.1 time: 0.154235 Jul 19 20:51:13.194940 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 153/334] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:13 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:13.588884 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b02f7078-f5bf-42dd-b887-3e987469174e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:13.589617 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b02f7078-f5bf-42dd-b887-3e987469174e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:13.596230 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b02f7078-f5bf-42dd-b887-3e987469174e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:13.596672 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b02f7078-f5bf-42dd-b887-3e987469174e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:13.597465 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b02f7078-f5bf-42dd-b887-3e987469174e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:13.597909 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b02f7078-f5bf-42dd-b887-3e987469174e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:13.623916 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ed197e8a-f41a-4f3d-b98b-204653c1ac22 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:13.624511 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ed197e8a-f41a-4f3d-b98b-204653c1ac22 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:13.632187 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ed197e8a-f41a-4f3d-b98b-204653c1ac22 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:13.632551 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ed197e8a-f41a-4f3d-b98b-204653c1ac22 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:13.633341 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ed197e8a-f41a-4f3d-b98b-204653c1ac22 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:13.633793 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ed197e8a-f41a-4f3d-b98b-204653c1ac22 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:13.787001 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b02f7078-f5bf-42dd-b887-3e987469174e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:13.795482 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b02f7078-f5bf-42dd-b887-3e987469174e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1314 microversion: 2.1 time: 0.210835 Jul 19 20:51:13.796041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 182/335] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:13 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:13.813554 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ed197e8a-f41a-4f3d-b98b-204653c1ac22 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:13.821193 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ed197e8a-f41a-4f3d-b98b-204653c1ac22 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.200986 Jul 19 20:51:13.822169 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 154/336] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:13 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:14.212325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3f381c16-ac51-4dad-9711-fbecd680639e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:14.212968 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3f381c16-ac51-4dad-9711-fbecd680639e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:14.219481 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3f381c16-ac51-4dad-9711-fbecd680639e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:14.220230 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3f381c16-ac51-4dad-9711-fbecd680639e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:14.221037 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3f381c16-ac51-4dad-9711-fbecd680639e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:14.221541 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3f381c16-ac51-4dad-9711-fbecd680639e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:14.393559 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3f381c16-ac51-4dad-9711-fbecd680639e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:14.400268 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3f381c16-ac51-4dad-9711-fbecd680639e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1510 microversion: 2.1 time: 0.192084 Jul 19 20:51:14.401486 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 183/337] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:14 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:14.812036 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-3d7f8d21-f3fb-4df9-8a9b-9a8571a86de2 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:14.812959 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-3d7f8d21-f3fb-4df9-8a9b-9a8571a86de2 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:14.819760 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3d7f8d21-f3fb-4df9-8a9b-9a8571a86de2 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:14.820217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3d7f8d21-f3fb-4df9-8a9b-9a8571a86de2 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:14.820996 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3d7f8d21-f3fb-4df9-8a9b-9a8571a86de2 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:14.821469 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3d7f8d21-f3fb-4df9-8a9b-9a8571a86de2 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:14.838553 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0df6a214-d07b-4279-b0d9-812dc9b9feb6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:14.839317 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0df6a214-d07b-4279-b0d9-812dc9b9feb6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:14.846638 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0df6a214-d07b-4279-b0d9-812dc9b9feb6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:14.847226 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0df6a214-d07b-4279-b0d9-812dc9b9feb6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:14.848103 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0df6a214-d07b-4279-b0d9-812dc9b9feb6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:14.848665 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0df6a214-d07b-4279-b0d9-812dc9b9feb6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:15.055641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3d7f8d21-f3fb-4df9-8a9b-9a8571a86de2 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:15.065345 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-3d7f8d21-f3fb-4df9-8a9b-9a8571a86de2 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1314 microversion: 2.1 time: 0.256989 Jul 19 20:51:15.075702 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 155/338] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:14 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:15.088514 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0df6a214-d07b-4279-b0d9-812dc9b9feb6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:15.100929 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0df6a214-d07b-4279-b0d9-812dc9b9feb6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.266164 Jul 19 20:51:15.101551 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 184/339] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:14 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:15.418677 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-69c0cfb8-e784-43a4-afaf-df0e392fe2d1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:15.419315 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-69c0cfb8-e784-43a4-afaf-df0e392fe2d1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:15.425526 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-69c0cfb8-e784-43a4-afaf-df0e392fe2d1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:15.425989 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-69c0cfb8-e784-43a4-afaf-df0e392fe2d1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:15.426775 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-69c0cfb8-e784-43a4-afaf-df0e392fe2d1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:15.427204 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-69c0cfb8-e784-43a4-afaf-df0e392fe2d1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:15.579360 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-69c0cfb8-e784-43a4-afaf-df0e392fe2d1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:15.588378 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-69c0cfb8-e784-43a4-afaf-df0e392fe2d1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1516 microversion: 2.1 time: 0.173482 Jul 19 20:51:15.589609 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 156/340] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:15 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:16.083106 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-442ac0ea-977c-4c09-a8a6-832b8f0ad190 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:16.083811 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-442ac0ea-977c-4c09-a8a6-832b8f0ad190 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:16.091611 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-442ac0ea-977c-4c09-a8a6-832b8f0ad190 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:16.092075 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-442ac0ea-977c-4c09-a8a6-832b8f0ad190 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:16.092884 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-442ac0ea-977c-4c09-a8a6-832b8f0ad190 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:16.093296 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-442ac0ea-977c-4c09-a8a6-832b8f0ad190 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:16.119751 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-29d74dcb-e396-4b60-b31d-aa0718cc8e00 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:16.120533 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-29d74dcb-e396-4b60-b31d-aa0718cc8e00 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:16.143952 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-29d74dcb-e396-4b60-b31d-aa0718cc8e00 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:16.144542 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-29d74dcb-e396-4b60-b31d-aa0718cc8e00 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:16.145326 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-29d74dcb-e396-4b60-b31d-aa0718cc8e00 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:16.145797 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-29d74dcb-e396-4b60-b31d-aa0718cc8e00 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:16.317295 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-442ac0ea-977c-4c09-a8a6-832b8f0ad190 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:16.326552 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-442ac0ea-977c-4c09-a8a6-832b8f0ad190 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1314 microversion: 2.1 time: 0.247253 Jul 19 20:51:16.327155 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 185/341] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:16 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:16.354757 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-29d74dcb-e396-4b60-b31d-aa0718cc8e00 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:16.368995 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-29d74dcb-e396-4b60-b31d-aa0718cc8e00 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.254732 Jul 19 20:51:16.369665 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 157/342] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:16 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:16.983323 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-60ca6a47-aa82-4bd2-8f23-dd179d0a1780 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Action: 'create', calling method: .version_select at 0x7f25343aa430>, body: {"keypair": {"name": "tempest-keypair-528710661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbTTyc5iQANhgZWXeQyVssSPDOBe5d2FujJVlWqNoqbvVoPDP78WJSDHE3HBy1+Ho8LLcAEW7OcDB0uPr9nGCsek9DUGT36PZDLsnyJk4gnR3rEVAGTzgdOeuBUMJU/4Q=="}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:16.987581 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:16.988326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=8 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:17.003260 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-60ca6a47-aa82-4bd2-8f23-dd179d0a1780 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Getting quotas for project 6cc474e26dd8444b99645279c4d133bf. Resources: {'key_pairs'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:51:17.007887 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-60ca6a47-aa82-4bd2-8f23-dd179d0a1780 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Getting quotas for user 9fa96f51390e46e991c6e9afa385d2f7 and project 6cc474e26dd8444b99645279c4d133bf. Resources: {'key_pairs'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:51:17.033867 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-60ca6a47-aa82-4bd2-8f23-dd179d0a1780 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054627 Jul 19 20:51:17.034473 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 186/343] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jul 19 20:51:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:17.344221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9f6d3fa9-570f-4ed0-8943-e799d3afc46e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:17.345223 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9f6d3fa9-570f-4ed0-8943-e799d3afc46e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:17.352570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f6d3fa9-570f-4ed0-8943-e799d3afc46e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:17.353017 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f6d3fa9-570f-4ed0-8943-e799d3afc46e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:17.353832 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f6d3fa9-570f-4ed0-8943-e799d3afc46e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:17.354274 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f6d3fa9-570f-4ed0-8943-e799d3afc46e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:17.390115 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7b9431d6-4f6d-4c43-822a-c0fbd308102e tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:17.392006 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-7b9431d6-4f6d-4c43-822a-c0fbd308102e tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:17.398935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b9431d6-4f6d-4c43-822a-c0fbd308102e tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:17.400278 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b9431d6-4f6d-4c43-822a-c0fbd308102e tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:17.401295 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b9431d6-4f6d-4c43-822a-c0fbd308102e tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:17.402540 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b9431d6-4f6d-4c43-822a-c0fbd308102e tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:17.578271 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9f6d3fa9-570f-4ed0-8943-e799d3afc46e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:17.589913 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9f6d3fa9-570f-4ed0-8943-e799d3afc46e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1314 microversion: 2.1 time: 0.249966 Jul 19 20:51:17.590714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 158/344] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:17 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:17.624227 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-7b9431d6-4f6d-4c43-822a-c0fbd308102e tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:17.638169 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-7b9431d6-4f6d-4c43-822a-c0fbd308102e tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.253752 Jul 19 20:51:17.639100 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 187/345] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:17 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:18.475079 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1155418872", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e54078f-19e8-413b-aba4-4db8046602ff"}], "security_groups": [{"name": "tempest-securitygroup--512673282"}], "key_name": "tempest-keypair-528710661", "user_data": "}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:18.580744 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.network.neutron [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] validate_networks() for [('2e54078f-19e8-413b-aba4-4db8046602ff', None, None, None, None, None)] {{(pid=129867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:51:18.608260 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4f903a92-fafe-48dc-b441-4720a393d02b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:18.608955 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4f903a92-fafe-48dc-b441-4720a393d02b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:18.615515 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4f903a92-fafe-48dc-b441-4720a393d02b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:18.616050 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4f903a92-fafe-48dc-b441-4720a393d02b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:18.616896 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4f903a92-fafe-48dc-b441-4720a393d02b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:18.617427 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4f903a92-fafe-48dc-b441-4720a393d02b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:18.826359 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4f903a92-fafe-48dc-b441-4720a393d02b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:18.836452 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4f903a92-fafe-48dc-b441-4720a393d02b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1314 microversion: 2.1 time: 0.232207 Jul 19 20:51:18.837059 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 188/346] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:18 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:18.846727 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3ef67987-a23c-4f08-8eb5-8898c5e274c3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:18.847346 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3ef67987-a23c-4f08-8eb5-8898c5e274c3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:18.854462 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ef67987-a23c-4f08-8eb5-8898c5e274c3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:18.855051 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ef67987-a23c-4f08-8eb5-8898c5e274c3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:18.855831 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ef67987-a23c-4f08-8eb5-8898c5e274c3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:18.856316 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ef67987-a23c-4f08-8eb5-8898c5e274c3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:19.346057 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3ef67987-a23c-4f08-8eb5-8898c5e274c3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:19.353891 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3ef67987-a23c-4f08-8eb5-8898c5e274c3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1314 microversion: 2.1 time: 0.515753 Jul 19 20:51:19.354554 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 189/347] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:18 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:19.371370 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Flavor limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:51:19.371857 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Image limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:51:19.372425 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Flavor pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:51:19.372902 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Image pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:51:19.373450 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:51:19.383168 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:19.383616 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:19.384404 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:19.384833 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:19.401719 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Getting quotas for project 6cc474e26dd8444b99645279c4d133bf. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:51:19.405586 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Getting quotas for user 9fa96f51390e46e991c6e9afa385d2f7 and project 6cc474e26dd8444b99645279c4d133bf. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:51:19.416587 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Going to run 1 instances... {{(pid=129867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:51:19.418871 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:51:19.469656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5151d514-5437-448b-932b-589bf7ffd358 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.998763 Jul 19 20:51:19.470647 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 159/348] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:51:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:51:19.481005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-655c92ef-b595-480d-b491-4269957aa491 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:19.481651 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-655c92ef-b595-480d-b491-4269957aa491 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:19.540361 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-655c92ef-b595-480d-b491-4269957aa491 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:19.549158 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-655c92ef-b595-480d-b491-4269957aa491 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1245 microversion: 2.1 time: 0.072013 Jul 19 20:51:19.549982 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 190/349] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:19 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:19.855191 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-35219807-ce62-403c-b2d8-e85502a850e5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:19.856159 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-35219807-ce62-403c-b2d8-e85502a850e5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:19.864815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-35219807-ce62-403c-b2d8-e85502a850e5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:19.865396 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-35219807-ce62-403c-b2d8-e85502a850e5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:19.866251 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-35219807-ce62-403c-b2d8-e85502a850e5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:19.866766 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-35219807-ce62-403c-b2d8-e85502a850e5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:20.029272 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-35219807-ce62-403c-b2d8-e85502a850e5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:20.039283 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-35219807-ce62-403c-b2d8-e85502a850e5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1314 microversion: 2.1 time: 0.187988 Jul 19 20:51:20.040122 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 160/350] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:19 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:20.375280 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-03f47be0-c584-4426-bbd4-1bd1c39395a6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:20.375905 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-03f47be0-c584-4426-bbd4-1bd1c39395a6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:20.384751 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-03f47be0-c584-4426-bbd4-1bd1c39395a6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:20.385125 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-03f47be0-c584-4426-bbd4-1bd1c39395a6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:20.385953 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-03f47be0-c584-4426-bbd4-1bd1c39395a6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:20.386385 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-03f47be0-c584-4426-bbd4-1bd1c39395a6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:20.566873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f9c7298b-3b8f-4652-8bff-72793858394e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:20.567704 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f9c7298b-3b8f-4652-8bff-72793858394e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:20.572441 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-03f47be0-c584-4426-bbd4-1bd1c39395a6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:20.580645 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f9c7298b-3b8f-4652-8bff-72793858394e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:20.582971 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-03f47be0-c584-4426-bbd4-1bd1c39395a6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1464 microversion: 2.1 time: 0.215109 Jul 19 20:51:20.597442 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f9c7298b-3b8f-4652-8bff-72793858394e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:20.600378 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 191/351] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:20 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1464 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:20.600862 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f9c7298b-3b8f-4652-8bff-72793858394e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:20.600862 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f9c7298b-3b8f-4652-8bff-72793858394e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:20.666128 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3340f4bd-983e-4862-87b9-e8cf008dec0c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:20.667009 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3340f4bd-983e-4862-87b9-e8cf008dec0c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:20.688087 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3340f4bd-983e-4862-87b9-e8cf008dec0c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:20.688787 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3340f4bd-983e-4862-87b9-e8cf008dec0c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:20.690079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3340f4bd-983e-4862-87b9-e8cf008dec0c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:20.690865 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3340f4bd-983e-4862-87b9-e8cf008dec0c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:20.721732 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f9c7298b-3b8f-4652-8bff-72793858394e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:20.731371 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f9c7298b-3b8f-4652-8bff-72793858394e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1305 microversion: 2.1 time: 0.169024 Jul 19 20:51:20.732560 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 161/352] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:20 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1305 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:20.763660 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3340f4bd-983e-4862-87b9-e8cf008dec0c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Going to try to terminate instance {{(pid=129866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:51:20.925461 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:20.959685 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3340f4bd-983e-4862-87b9-e8cf008dec0c tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 204 len: 0 microversion: 2.1 time: 0.297599 Jul 19 20:51:20.963579 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 192/353] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:51:20 2022] DELETE /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:51:20.972784 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a0df3a74-17f7-44ba-b9aa-5f57774baba6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:20.979640 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a0df3a74-17f7-44ba-b9aa-5f57774baba6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:20.987368 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a0df3a74-17f7-44ba-b9aa-5f57774baba6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:20.997837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a0df3a74-17f7-44ba-b9aa-5f57774baba6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.000512 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a0df3a74-17f7-44ba-b9aa-5f57774baba6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.001667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a0df3a74-17f7-44ba-b9aa-5f57774baba6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.061966 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3bd42c4e-34de-4b2f-bbc6-120e1bdca051 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:21.063595 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3bd42c4e-34de-4b2f-bbc6-120e1bdca051 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:21.070528 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3bd42c4e-34de-4b2f-bbc6-120e1bdca051 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.071141 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3bd42c4e-34de-4b2f-bbc6-120e1bdca051 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.072073 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3bd42c4e-34de-4b2f-bbc6-120e1bdca051 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.072622 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3bd42c4e-34de-4b2f-bbc6-120e1bdca051 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.223010 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a0df3a74-17f7-44ba-b9aa-5f57774baba6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:21.233611 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a0df3a74-17f7-44ba-b9aa-5f57774baba6 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1470 microversion: 2.1 time: 0.267874 Jul 19 20:51:21.234249 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 162/354] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:20 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1470 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:21.266155 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3bd42c4e-34de-4b2f-bbc6-120e1bdca051 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:21.276087 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3bd42c4e-34de-4b2f-bbc6-120e1bdca051 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1314 microversion: 2.1 time: 0.219582 Jul 19 20:51:21.276798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 193/355] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:21 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:21.748396 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7eb56167-9c28-45c9-9f7d-59f7fd66aca4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:21.749328 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7eb56167-9c28-45c9-9f7d-59f7fd66aca4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:21.756567 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7eb56167-9c28-45c9-9f7d-59f7fd66aca4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.757010 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7eb56167-9c28-45c9-9f7d-59f7fd66aca4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.757858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7eb56167-9c28-45c9-9f7d-59f7fd66aca4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:21.758293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7eb56167-9c28-45c9-9f7d-59f7fd66aca4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:21.899159 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7eb56167-9c28-45c9-9f7d-59f7fd66aca4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:21.907672 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7eb56167-9c28-45c9-9f7d-59f7fd66aca4 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1370 microversion: 2.1 time: 0.163328 Jul 19 20:51:21.908277 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 163/356] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:21 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:22.256042 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c3489e25-82e5-4bf6-a789-d8c1afb6e37d tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:22.256696 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c3489e25-82e5-4bf6-a789-d8c1afb6e37d tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:22.264158 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c3489e25-82e5-4bf6-a789-d8c1afb6e37d tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:22.266345 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c3489e25-82e5-4bf6-a789-d8c1afb6e37d tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:22.267544 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c3489e25-82e5-4bf6-a789-d8c1afb6e37d tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:22.268227 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c3489e25-82e5-4bf6-a789-d8c1afb6e37d tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:22.302826 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f9b8f021-7d38-4b4d-a486-1d632729d80f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:22.304165 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f9b8f021-7d38-4b4d-a486-1d632729d80f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:22.314616 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f9b8f021-7d38-4b4d-a486-1d632729d80f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:22.315533 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f9b8f021-7d38-4b4d-a486-1d632729d80f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:22.316403 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f9b8f021-7d38-4b4d-a486-1d632729d80f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:22.317083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f9b8f021-7d38-4b4d-a486-1d632729d80f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:22.484298 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c3489e25-82e5-4bf6-a789-d8c1afb6e37d tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:22.498234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c3489e25-82e5-4bf6-a789-d8c1afb6e37d tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1470 microversion: 2.1 time: 0.246325 Jul 19 20:51:22.499771 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 194/357] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:22 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1470 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:22.511337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-1cf75bc1-baea-4a54-9999-7cc5bc39b9e6 req-386ddd44-fd09-4c86-8edc-de86a1a8460f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8500d09-a98f-4348-bfdf-de65c829dadf", "name": "network-vif-plugged", "status": "completed", "tag": "5e3cbb90-f209-4384-96d7-fddc117d1772"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:22.520010 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f9b8f021-7d38-4b4d-a486-1d632729d80f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:22.529958 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-1cf75bc1-baea-4a54-9999-7cc5bc39b9e6 req-386ddd44-fd09-4c86-8edc-de86a1a8460f service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:22.530759 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-1cf75bc1-baea-4a54-9999-7cc5bc39b9e6 req-386ddd44-fd09-4c86-8edc-de86a1a8460f service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:22.533015 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f9b8f021-7d38-4b4d-a486-1d632729d80f tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1314 microversion: 2.1 time: 0.234892 Jul 19 20:51:22.544246 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 164/358] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:22 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:22.548273 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-1cf75bc1-baea-4a54-9999-7cc5bc39b9e6 req-386ddd44-fd09-4c86-8edc-de86a1a8460f service nova] Creating event network-vif-plugged:5e3cbb90-f209-4384-96d7-fddc117d1772 for instance d8500d09-a98f-4348-bfdf-de65c829dadf on hv-cinder-79987 Jul 19 20:51:22.553617 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-1cf75bc1-baea-4a54-9999-7cc5bc39b9e6 req-386ddd44-fd09-4c86-8edc-de86a1a8460f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050253 Jul 19 20:51:22.554242 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 195/359] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:22.925060 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-95c2f557-33e7-401b-be58-97f5fef3bb78 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:22.925709 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-95c2f557-33e7-401b-be58-97f5fef3bb78 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:22.931844 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-95c2f557-33e7-401b-be58-97f5fef3bb78 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:22.932288 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-95c2f557-33e7-401b-be58-97f5fef3bb78 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:22.933055 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-95c2f557-33e7-401b-be58-97f5fef3bb78 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:22.933519 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-95c2f557-33e7-401b-be58-97f5fef3bb78 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:23.088064 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-98e9e169-f286-4e69-a3d9-15a369dd7de0 req-10cbd306-8843-450a-a80e-4b181ea10711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272b6112-4d76-4d2f-84ab-4382b998c781", "tag": "c39b17d3-41ea-48aa-ace5-2a3ac46873d7"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:23.090174 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-95c2f557-33e7-401b-be58-97f5fef3bb78 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:23.099961 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-95c2f557-33e7-401b-be58-97f5fef3bb78 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1370 microversion: 2.1 time: 0.179269 Jul 19 20:51:23.102268 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 165/360] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:22 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:23.121394 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-98e9e169-f286-4e69-a3d9-15a369dd7de0 req-10cbd306-8843-450a-a80e-4b181ea10711 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:23.121989 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-98e9e169-f286-4e69-a3d9-15a369dd7de0 req-10cbd306-8843-450a-a80e-4b181ea10711 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:23.135119 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-98e9e169-f286-4e69-a3d9-15a369dd7de0 req-10cbd306-8843-450a-a80e-4b181ea10711 service nova] Creating event network-changed:c39b17d3-41ea-48aa-ace5-2a3ac46873d7 for instance 272b6112-4d76-4d2f-84ab-4382b998c781 on hv-cinder-79987 Jul 19 20:51:23.141452 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-98e9e169-f286-4e69-a3d9-15a369dd7de0 req-10cbd306-8843-450a-a80e-4b181ea10711 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058641 Jul 19 20:51:23.142601 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 196/361] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:23.527210 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fc8d7d2d-19e3-4ad8-a5b2-378284dd7fa3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:23.527840 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-fc8d7d2d-19e3-4ad8-a5b2-378284dd7fa3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:23.534579 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fc8d7d2d-19e3-4ad8-a5b2-378284dd7fa3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:23.535031 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fc8d7d2d-19e3-4ad8-a5b2-378284dd7fa3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:23.535792 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fc8d7d2d-19e3-4ad8-a5b2-378284dd7fa3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:23.536229 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fc8d7d2d-19e3-4ad8-a5b2-378284dd7fa3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:23.554484 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b99a804b-3b82-4f4c-a377-62e4aa853dbe tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:23.555823 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b99a804b-3b82-4f4c-a377-62e4aa853dbe tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:23.562185 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b99a804b-3b82-4f4c-a377-62e4aa853dbe tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:23.563131 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b99a804b-3b82-4f4c-a377-62e4aa853dbe tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:23.563894 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b99a804b-3b82-4f4c-a377-62e4aa853dbe tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:23.564438 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b99a804b-3b82-4f4c-a377-62e4aa853dbe tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:23.753140 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-fc8d7d2d-19e3-4ad8-a5b2-378284dd7fa3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:23.760945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b99a804b-3b82-4f4c-a377-62e4aa853dbe tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:23.766242 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fc8d7d2d-19e3-4ad8-a5b2-378284dd7fa3 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1470 microversion: 2.1 time: 0.242869 Jul 19 20:51:23.766833 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 166/362] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:23 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1470 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:23.783964 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b99a804b-3b82-4f4c-a377-62e4aa853dbe tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1314 microversion: 2.1 time: 0.233616 Jul 19 20:51:23.785087 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 197/363] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:23 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:24.118677 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2566f012-4749-4a9f-b52c-87224165fefc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:24.119292 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2566f012-4749-4a9f-b52c-87224165fefc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:24.125806 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2566f012-4749-4a9f-b52c-87224165fefc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:24.126249 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2566f012-4749-4a9f-b52c-87224165fefc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:24.127035 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2566f012-4749-4a9f-b52c-87224165fefc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:24.127473 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2566f012-4749-4a9f-b52c-87224165fefc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:24.273944 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2566f012-4749-4a9f-b52c-87224165fefc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:24.283494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2566f012-4749-4a9f-b52c-87224165fefc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1370 microversion: 2.1 time: 0.168688 Jul 19 20:51:24.284092 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 167/364] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:24 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:24.784057 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8de7c265-55c2-4e51-83ec-892b532f94bf tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:24.784795 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8de7c265-55c2-4e51-83ec-892b532f94bf tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:24.790965 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8de7c265-55c2-4e51-83ec-892b532f94bf tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:24.791409 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8de7c265-55c2-4e51-83ec-892b532f94bf tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:24.792168 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8de7c265-55c2-4e51-83ec-892b532f94bf tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:24.792595 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8de7c265-55c2-4e51-83ec-892b532f94bf tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:24.801325 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b0ed96cb-0e6a-4d71-a8b0-a18c0a9d05b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:24.801955 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b0ed96cb-0e6a-4d71-a8b0-a18c0a9d05b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:24.804375 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:24.810210 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b0ed96cb-0e6a-4d71-a8b0-a18c0a9d05b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:24.810668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b0ed96cb-0e6a-4d71-a8b0-a18c0a9d05b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:24.811451 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b0ed96cb-0e6a-4d71-a8b0-a18c0a9d05b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:24.811888 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b0ed96cb-0e6a-4d71-a8b0-a18c0a9d05b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:24.824276 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8de7c265-55c2-4e51-83ec-892b532f94bf tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:24.824725 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8de7c265-55c2-4e51-83ec-892b532f94bf tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:24.825175 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-8de7c265-55c2-4e51-83ec-892b532f94bf tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lazy-loading 'fault' on Instance uuid 6e2962f7-f6f6-4084-8568-9885f6b05892 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:51:24.876382 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-8de7c265-55c2-4e51-83ec-892b532f94bf tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:24.883960 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8de7c265-55c2-4e51-83ec-892b532f94bf tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1304 microversion: 2.1 time: 0.104928 Jul 19 20:51:24.884535 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 198/365] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:24 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:24.968127 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b0ed96cb-0e6a-4d71-a8b0-a18c0a9d05b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:24.976192 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b0ed96cb-0e6a-4d71-a8b0-a18c0a9d05b5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1499 microversion: 2.1 time: 0.178826 Jul 19 20:51:24.976775 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 168/366] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:24 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1499 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:25.170026 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-fbe0b255-0ce3-4525-9c49-e2cf8512817f req-bb51a694-db2c-4fb2-a4a2-64227f57a253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2962f7-f6f6-4084-8568-9885f6b05892", "name": "network-vif-deleted", "tag": "fbd23da3-8a4b-4932-ae42-f3830da909f8"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:25.179159 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-fbe0b255-0ce3-4525-9c49-e2cf8512817f req-bb51a694-db2c-4fb2-a4a2-64227f57a253 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.179605 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-fbe0b255-0ce3-4525-9c49-e2cf8512817f req-bb51a694-db2c-4fb2-a4a2-64227f57a253 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.193217 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-fbe0b255-0ce3-4525-9c49-e2cf8512817f req-bb51a694-db2c-4fb2-a4a2-64227f57a253 service nova] Creating event network-vif-deleted:fbd23da3-8a4b-4932-ae42-f3830da909f8 for instance 6e2962f7-f6f6-4084-8568-9885f6b05892 on hv-cinder-79987 Jul 19 20:51:25.198338 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-fbe0b255-0ce3-4525-9c49-e2cf8512817f req-bb51a694-db2c-4fb2-a4a2-64227f57a253 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032364 Jul 19 20:51:25.198949 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 199/367] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:25.301018 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fecfa14f-bfe3-4413-a3b8-48f548634d2f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:25.301543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-fecfa14f-bfe3-4413-a3b8-48f548634d2f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:25.308132 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fecfa14f-bfe3-4413-a3b8-48f548634d2f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.308593 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fecfa14f-bfe3-4413-a3b8-48f548634d2f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.309401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fecfa14f-bfe3-4413-a3b8-48f548634d2f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.309851 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fecfa14f-bfe3-4413-a3b8-48f548634d2f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.312692 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=100 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:25.469666 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c100e91f-ce31-4687-97a1-47915e090a0a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:25.469849 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-fecfa14f-bfe3-4413-a3b8-48f548634d2f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:25.471149 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c100e91f-ce31-4687-97a1-47915e090a0a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:25.478216 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fecfa14f-bfe3-4413-a3b8-48f548634d2f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1370 microversion: 2.1 time: 0.181525 Jul 19 20:51:25.479002 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 169/368] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:25 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:25.479404 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c100e91f-ce31-4687-97a1-47915e090a0a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.480213 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c100e91f-ce31-4687-97a1-47915e090a0a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.481207 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c100e91f-ce31-4687-97a1-47915e090a0a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.481866 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c100e91f-ce31-4687-97a1-47915e090a0a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.485086 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:25.510539 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c100e91f-ce31-4687-97a1-47915e090a0a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Going to try to terminate instance {{(pid=129866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:51:25.594769 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c100e91f-ce31-4687-97a1-47915e090a0a tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 204 len: 0 microversion: 2.1 time: 0.130158 Jul 19 20:51:25.595685 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 200/369] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:51:25 2022] DELETE /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:51:25.606122 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b906c025-5511-47b0-8324-313641b16c0e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:25.607050 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b906c025-5511-47b0-8324-313641b16c0e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:25.614858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b906c025-5511-47b0-8324-313641b16c0e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.615311 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b906c025-5511-47b0-8324-313641b16c0e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.616375 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b906c025-5511-47b0-8324-313641b16c0e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.616904 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b906c025-5511-47b0-8324-313641b16c0e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.766546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b906c025-5511-47b0-8324-313641b16c0e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:25.774534 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b906c025-5511-47b0-8324-313641b16c0e tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1505 microversion: 2.1 time: 0.172881 Jul 19 20:51:25.775117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 170/370] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:25 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:25.903592 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0d395e9b-bb5d-4e2a-854a-888c8d53b2b5 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:25.904209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0d395e9b-bb5d-4e2a-854a-888c8d53b2b5 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:25.911177 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0d395e9b-bb5d-4e2a-854a-888c8d53b2b5 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.911631 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0d395e9b-bb5d-4e2a-854a-888c8d53b2b5 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.912415 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0d395e9b-bb5d-4e2a-854a-888c8d53b2b5 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.912853 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0d395e9b-bb5d-4e2a-854a-888c8d53b2b5 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.947736 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0d395e9b-bb5d-4e2a-854a-888c8d53b2b5 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:25.948196 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0d395e9b-bb5d-4e2a-854a-888c8d53b2b5 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:25.948652 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-0d395e9b-bb5d-4e2a-854a-888c8d53b2b5 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lazy-loading 'fault' on Instance uuid 6e2962f7-f6f6-4084-8568-9885f6b05892 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:51:25.995719 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0d395e9b-bb5d-4e2a-854a-888c8d53b2b5 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:26.006411 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0d395e9b-bb5d-4e2a-854a-888c8d53b2b5 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1304 microversion: 2.1 time: 0.107165 Jul 19 20:51:26.007239 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 201/371] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:25 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:26.497133 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-81a314ff-1e5f-4867-90d6-350e51ffa958 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:26.497761 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-81a314ff-1e5f-4867-90d6-350e51ffa958 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:26.504970 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-81a314ff-1e5f-4867-90d6-350e51ffa958 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:26.505486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-81a314ff-1e5f-4867-90d6-350e51ffa958 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:26.506280 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-81a314ff-1e5f-4867-90d6-350e51ffa958 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:26.506726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-81a314ff-1e5f-4867-90d6-350e51ffa958 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:26.663011 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-81a314ff-1e5f-4867-90d6-350e51ffa958 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:26.671604 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-81a314ff-1e5f-4867-90d6-350e51ffa958 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1370 microversion: 2.1 time: 0.178455 Jul 19 20:51:26.672764 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 171/372] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:26 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:26.797208 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7281155a-4bec-4e61-827d-f2ce17484eb5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:26.798360 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-7281155a-4bec-4e61-827d-f2ce17484eb5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:26.809314 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7281155a-4bec-4e61-827d-f2ce17484eb5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:26.809857 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7281155a-4bec-4e61-827d-f2ce17484eb5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:26.810824 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7281155a-4bec-4e61-827d-f2ce17484eb5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:26.811545 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7281155a-4bec-4e61-827d-f2ce17484eb5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:26.961382 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-7281155a-4bec-4e61-827d-f2ce17484eb5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:26.969853 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-7281155a-4bec-4e61-827d-f2ce17484eb5 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1505 microversion: 2.1 time: 0.180388 Jul 19 20:51:26.970699 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 202/373] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:26 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:27.034676 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-320bdd24-521d-4524-8186-6eee6db95624 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:27.035458 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-320bdd24-521d-4524-8186-6eee6db95624 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:27.042661 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-320bdd24-521d-4524-8186-6eee6db95624 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:27.043108 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-320bdd24-521d-4524-8186-6eee6db95624 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:27.043880 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-320bdd24-521d-4524-8186-6eee6db95624 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:27.044312 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-320bdd24-521d-4524-8186-6eee6db95624 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:27.079148 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-320bdd24-521d-4524-8186-6eee6db95624 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:27.079591 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-320bdd24-521d-4524-8186-6eee6db95624 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:27.080041 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-320bdd24-521d-4524-8186-6eee6db95624 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lazy-loading 'fault' on Instance uuid 6e2962f7-f6f6-4084-8568-9885f6b05892 {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:51:27.123972 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-320bdd24-521d-4524-8186-6eee6db95624 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:27.132765 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-320bdd24-521d-4524-8186-6eee6db95624 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1304 microversion: 2.1 time: 0.102925 Jul 19 20:51:27.133377 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 172/374] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:27 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:27.690447 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5e62b706-cdb3-4241-84d5-00a516894d6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:27.691207 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5e62b706-cdb3-4241-84d5-00a516894d6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:27.697783 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5e62b706-cdb3-4241-84d5-00a516894d6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:27.698247 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5e62b706-cdb3-4241-84d5-00a516894d6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:27.699024 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5e62b706-cdb3-4241-84d5-00a516894d6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:27.699467 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5e62b706-cdb3-4241-84d5-00a516894d6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:27.881460 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5e62b706-cdb3-4241-84d5-00a516894d6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:27.889110 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5e62b706-cdb3-4241-84d5-00a516894d6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1370 microversion: 2.1 time: 0.203819 Jul 19 20:51:27.889735 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 203/375] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:27 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:27.990005 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2021aa50-f235-41c5-be7b-b2f90de96262 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:27.990758 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2021aa50-f235-41c5-be7b-b2f90de96262 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:27.998360 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2021aa50-f235-41c5-be7b-b2f90de96262 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:27.999033 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2021aa50-f235-41c5-be7b-b2f90de96262 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:28.000709 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2021aa50-f235-41c5-be7b-b2f90de96262 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:28.001686 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2021aa50-f235-41c5-be7b-b2f90de96262 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:28.151408 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c08f6adf-3f84-4267-9cd3-12c3ee3c7192 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:28.152108 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c08f6adf-3f84-4267-9cd3-12c3ee3c7192 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:28.153294 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2021aa50-f235-41c5-be7b-b2f90de96262 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:28.159359 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c08f6adf-3f84-4267-9cd3-12c3ee3c7192 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:28.159916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c08f6adf-3f84-4267-9cd3-12c3ee3c7192 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:28.160705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c08f6adf-3f84-4267-9cd3-12c3ee3c7192 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:28.161226 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c08f6adf-3f84-4267-9cd3-12c3ee3c7192 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:28.178075 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2021aa50-f235-41c5-be7b-b2f90de96262 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1505 microversion: 2.1 time: 0.180763 Jul 19 20:51:28.178075 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 173/376] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:27 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:28.196195 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c08f6adf-3f84-4267-9cd3-12c3ee3c7192 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:28.196648 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c08f6adf-3f84-4267-9cd3-12c3ee3c7192 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:28.197114 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-c08f6adf-3f84-4267-9cd3-12c3ee3c7192 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lazy-loading 'fault' on Instance uuid 6e2962f7-f6f6-4084-8568-9885f6b05892 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:51:28.273635 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c08f6adf-3f84-4267-9cd3-12c3ee3c7192 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:28.285416 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c08f6adf-3f84-4267-9cd3-12c3ee3c7192 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1304 microversion: 2.1 time: 0.138363 Jul 19 20:51:28.286334 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 204/377] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:28 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:28.907580 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8c3e906e-94b4-4008-9969-aa0e626a993f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:28.908207 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8c3e906e-94b4-4008-9969-aa0e626a993f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:28.915028 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8c3e906e-94b4-4008-9969-aa0e626a993f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:28.915480 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8c3e906e-94b4-4008-9969-aa0e626a993f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:28.916267 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8c3e906e-94b4-4008-9969-aa0e626a993f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:28.916713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8c3e906e-94b4-4008-9969-aa0e626a993f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:29.082129 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8c3e906e-94b4-4008-9969-aa0e626a993f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:29.091414 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8c3e906e-94b4-4008-9969-aa0e626a993f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1370 microversion: 2.1 time: 0.188337 Jul 19 20:51:29.092115 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 174/378] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:28 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:29.185981 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3845c445-8399-4be0-b777-d7b28d2f533b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:29.186637 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3845c445-8399-4be0-b777-d7b28d2f533b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:29.193059 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3845c445-8399-4be0-b777-d7b28d2f533b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:29.193582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3845c445-8399-4be0-b777-d7b28d2f533b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:29.194368 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3845c445-8399-4be0-b777-d7b28d2f533b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:29.194809 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3845c445-8399-4be0-b777-d7b28d2f533b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:29.302963 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-953919f3-9667-4641-9015-bd245175c5ad tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:29.303589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-953919f3-9667-4641-9015-bd245175c5ad tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:29.313932 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-953919f3-9667-4641-9015-bd245175c5ad tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:29.314620 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-953919f3-9667-4641-9015-bd245175c5ad tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:29.315647 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-953919f3-9667-4641-9015-bd245175c5ad tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:29.316254 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-953919f3-9667-4641-9015-bd245175c5ad tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:29.336293 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3845c445-8399-4be0-b777-d7b28d2f533b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:29.344662 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3845c445-8399-4be0-b777-d7b28d2f533b tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1505 microversion: 2.1 time: 0.162813 Jul 19 20:51:29.345631 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 205/379] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:29 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:29.352803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-953919f3-9667-4641-9015-bd245175c5ad tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:29.353257 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-953919f3-9667-4641-9015-bd245175c5ad tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:29.353739 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-953919f3-9667-4641-9015-bd245175c5ad tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lazy-loading 'fault' on Instance uuid 6e2962f7-f6f6-4084-8568-9885f6b05892 {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:51:29.391597 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:29.397604 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-953919f3-9667-4641-9015-bd245175c5ad tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc46df6f92c4bc1a81c9f88ca366057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5285b463d71240629eb90b5251f4373f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:29.405735 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-953919f3-9667-4641-9015-bd245175c5ad tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 200 len: 1304 microversion: 2.1 time: 0.106689 Jul 19 20:51:29.406347 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 175/380] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:29 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:30.111671 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-534c023d-8722-460a-acfb-77f99565915f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:30.112991 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-534c023d-8722-460a-acfb-77f99565915f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:30.115950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=6 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:30.127028 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-534c023d-8722-460a-acfb-77f99565915f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:30.127735 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-534c023d-8722-460a-acfb-77f99565915f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:30.131796 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-534c023d-8722-460a-acfb-77f99565915f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:30.132318 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-534c023d-8722-460a-acfb-77f99565915f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:30.292915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-534c023d-8722-460a-acfb-77f99565915f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:30.306728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-534c023d-8722-460a-acfb-77f99565915f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1370 microversion: 2.1 time: 0.199093 Jul 19 20:51:30.307767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 206/381] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:30 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:30.364399 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-af4c598a-87f1-415a-ae94-c7ed6dfa6889 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:30.366231 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-af4c598a-87f1-415a-ae94-c7ed6dfa6889 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:30.374164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=6 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:30.378169 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-af4c598a-87f1-415a-ae94-c7ed6dfa6889 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:30.380016 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-af4c598a-87f1-415a-ae94-c7ed6dfa6889 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:30.381498 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-af4c598a-87f1-415a-ae94-c7ed6dfa6889 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:30.382202 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-af4c598a-87f1-415a-ae94-c7ed6dfa6889 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:30.433217 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-46eb151f-9a11-48ec-aa07-c3ec0f290d55 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:30.433890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-46eb151f-9a11-48ec-aa07-c3ec0f290d55 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] [instance: 6e2962f7-f6f6-4084-8568-9885f6b05892] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:30.447819 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-46eb151f-9a11-48ec-aa07-c3ec0f290d55 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:30.449170 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-46eb151f-9a11-48ec-aa07-c3ec0f290d55 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:30.451049 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-46eb151f-9a11-48ec-aa07-c3ec0f290d55 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:30.453718 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-46eb151f-9a11-48ec-aa07-c3ec0f290d55 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:30.477821 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-46eb151f-9a11-48ec-aa07-c3ec0f290d55 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] HTTP exception thrown: Instance 6e2962f7-f6f6-4084-8568-9885f6b05892 could not be found. Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-46eb151f-9a11-48ec-aa07-c3ec0f290d55 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Request method failure captured: Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 HTTP/1.1 Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xkpGVQx4_lbAg8cHGlEi4NgBTImg_W3iKzuaRP7R4fBC86rNW_i8H_j6ZrQh_HHOqmGlatEicSNUKGdJsSVp5X7TLpLqMZMVEHxj5Y0j8k31y91n6jyYxxGFHt7JNlNVOdFwa7PMVKD8T_ZYpdxoZJqDfonmd6DLWdoV1VhFpQdJls Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 5285b463d71240629eb90b5251f4373f Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-VolumesNegativeTest-1677228372 Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:51:30.480963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:51:30.482472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5285b463d71240629eb90b5251f4373f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5285b463d71240629eb90b5251f4373f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5285b463d71240629eb90b5251f4373f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5285b463d71240629eb90b5251f4373f", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:51:30.482472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-VolumesNegativeTest-1677228372 Jul 19 20:51:30.482472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 5285b463d71240629eb90b5251f4373f Jul 19 20:51:30.482472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-VolumesNegativeTest-1677228372 Jul 19 20:51:30.482472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-VolumesNegativeTest-1677228372-project Jul 19 20:51:30.482472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:51:30.482472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:51:30.482472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: bfc46df6f92c4bc1a81c9f88ca366057 Jul 19 20:51:30.482472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-VolumesNegativeTest-1677228372-project Jul 19 20:51:30.482472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:51:30.482472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 6e2962f7-f6f6-4084-8568-9885f6b05892 could not be found. Jul 19 20:51:30.482472 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '6e2962f7-f6f6-4084-8568-9885f6b05892'} Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2962f7-f6f6-4084-8568-9885f6b05892 could not be found. Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:51:30.483340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2962f7-f6f6-4084-8568-9885f6b05892 could not be found. Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2962f7-f6f6-4084-8568-9885f6b05892 could not be found. Jul 19 20:51:30.485105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:51:30.489531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-46eb151f-9a11-48ec-aa07-c3ec0f290d55 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] Returning 404 to user: Instance 6e2962f7-f6f6-4084-8568-9885f6b05892 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:51:30.491373 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-46eb151f-9a11-48ec-aa07-c3ec0f290d55 tempest-VolumesNegativeTest-1677228372 tempest-VolumesNegativeTest-1677228372-project] 10.222.0.70 "GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892" status: 404 len: 111 microversion: 2.1 time: 0.064606 Jul 19 20:51:30.492766 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 207/382] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:30 2022] GET /compute/v2.1/servers/6e2962f7-f6f6-4084-8568-9885f6b05892 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:51:30.603248 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-af4c598a-87f1-415a-ae94-c7ed6dfa6889 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:30.617116 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-af4c598a-87f1-415a-ae94-c7ed6dfa6889 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1505 microversion: 2.1 time: 0.257748 Jul 19 20:51:30.618773 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 176/383] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:30 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:51:30.632559 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-3b7aaae1-fa67-4d1e-a9f6-658e17df8af8 req-71c3161b-1cd4-4fb6-b371-0c16fcd3899d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272b6112-4d76-4d2f-84ab-4382b998c781", "name": "network-vif-plugged", "status": "completed", "tag": "c39b17d3-41ea-48aa-ace5-2a3ac46873d7"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:30.645961 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-3b7aaae1-fa67-4d1e-a9f6-658e17df8af8 req-71c3161b-1cd4-4fb6-b371-0c16fcd3899d service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:30.647501 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-3b7aaae1-fa67-4d1e-a9f6-658e17df8af8 req-71c3161b-1cd4-4fb6-b371-0c16fcd3899d service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:30.667388 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-3b7aaae1-fa67-4d1e-a9f6-658e17df8af8 req-71c3161b-1cd4-4fb6-b371-0c16fcd3899d service nova] Creating event network-vif-plugged:c39b17d3-41ea-48aa-ace5-2a3ac46873d7 for instance 272b6112-4d76-4d2f-84ab-4382b998c781 on hv-cinder-79987 Jul 19 20:51:30.675671 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-3b7aaae1-fa67-4d1e-a9f6-658e17df8af8 req-71c3161b-1cd4-4fb6-b371-0c16fcd3899d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048065 Jul 19 20:51:30.676843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 208/384] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:31.044027 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-fa3643b7-459f-4079-a787-3e58d7cf6647 req-489df952-d372-490a-b6e8-b824970c0990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8500d09-a98f-4348-bfdf-de65c829dadf", "name": "network-vif-deleted", "tag": "5e3cbb90-f209-4384-96d7-fddc117d1772"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:31.059957 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-fa3643b7-459f-4079-a787-3e58d7cf6647 req-489df952-d372-490a-b6e8-b824970c0990 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:31.060773 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-fa3643b7-459f-4079-a787-3e58d7cf6647 req-489df952-d372-490a-b6e8-b824970c0990 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:31.088905 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-fa3643b7-459f-4079-a787-3e58d7cf6647 req-489df952-d372-490a-b6e8-b824970c0990 service nova] Creating event network-vif-deleted:5e3cbb90-f209-4384-96d7-fddc117d1772 for instance d8500d09-a98f-4348-bfdf-de65c829dadf on hv-cinder-79987 Jul 19 20:51:31.097154 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-fa3643b7-459f-4079-a787-3e58d7cf6647 req-489df952-d372-490a-b6e8-b824970c0990 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059573 Jul 19 20:51:31.098719 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 177/385] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:31.330617 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-11bce72d-ce94-48fe-93aa-6dad29a0d8ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:31.331524 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-11bce72d-ce94-48fe-93aa-6dad29a0d8ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:31.342531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-11bce72d-ce94-48fe-93aa-6dad29a0d8ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:31.343286 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-11bce72d-ce94-48fe-93aa-6dad29a0d8ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:31.344474 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-11bce72d-ce94-48fe-93aa-6dad29a0d8ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:31.345504 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-11bce72d-ce94-48fe-93aa-6dad29a0d8ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:31.578696 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-11bce72d-ce94-48fe-93aa-6dad29a0d8ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:31.590597 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-11bce72d-ce94-48fe-93aa-6dad29a0d8ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1370 microversion: 2.1 time: 0.265261 Jul 19 20:51:31.591431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 209/386] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:31 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:31.646054 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-eee871f2-19df-4468-ac42-9bb47c7e5de3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:31.647229 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-eee871f2-19df-4468-ac42-9bb47c7e5de3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:31.656588 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-eee871f2-19df-4468-ac42-9bb47c7e5de3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:31.657306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-eee871f2-19df-4468-ac42-9bb47c7e5de3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:31.658388 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-eee871f2-19df-4468-ac42-9bb47c7e5de3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:31.658987 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-eee871f2-19df-4468-ac42-9bb47c7e5de3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:31.704748 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-eee871f2-19df-4468-ac42-9bb47c7e5de3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:31.705207 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-eee871f2-19df-4468-ac42-9bb47c7e5de3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:31.705732 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-eee871f2-19df-4468-ac42-9bb47c7e5de3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lazy-loading 'fault' on Instance uuid d8500d09-a98f-4348-bfdf-de65c829dadf {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:51:31.753852 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-eee871f2-19df-4468-ac42-9bb47c7e5de3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3e4ee4b3ca492cabf2622f0659b5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bc1c7a8029e4d40ac256dd2f877317b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:31.762779 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-eee871f2-19df-4468-ac42-9bb47c7e5de3 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 200 len: 1304 microversion: 2.1 time: 0.122597 Jul 19 20:51:31.763362 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 178/387] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:31 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:32.620306 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e1929d78-8e3b-419d-bf6b-03ad74288f68 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:32.621336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e1929d78-8e3b-419d-bf6b-03ad74288f68 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:32.631986 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e1929d78-8e3b-419d-bf6b-03ad74288f68 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:32.632676 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e1929d78-8e3b-419d-bf6b-03ad74288f68 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:32.633748 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e1929d78-8e3b-419d-bf6b-03ad74288f68 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:32.634294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e1929d78-8e3b-419d-bf6b-03ad74288f68 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:32.780459 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7a0bbd3a-e727-4887-b87c-021911e5c564 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:32.781602 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7a0bbd3a-e727-4887-b87c-021911e5c564 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] [instance: d8500d09-a98f-4348-bfdf-de65c829dadf] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:32.788759 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a0bbd3a-e727-4887-b87c-021911e5c564 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:32.789226 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a0bbd3a-e727-4887-b87c-021911e5c564 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:32.790291 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a0bbd3a-e727-4887-b87c-021911e5c564 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:32.790504 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a0bbd3a-e727-4887-b87c-021911e5c564 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:32.816968 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-7a0bbd3a-e727-4887-b87c-021911e5c564 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] HTTP exception thrown: Instance d8500d09-a98f-4348-bfdf-de65c829dadf could not be found. Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7a0bbd3a-e727-4887-b87c-021911e5c564 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Request method failure captured: Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf HTTP/1.1 Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xkZ54nb-YyPuOxuz0fnoiDlnQoCAtUGe-fWVDS9GXgAhOlVo3epgeHNQe6aumYt-lq7Q8yKz8cfj4YdoQK0Rg7ULTjdHv06XM0nDVSptpDZPcBGyZxkaEoRdYYtnrA4egRQ-HtOSJ-OmXb5N5Qg86KCTkvOkUK-1tOXb4UtyJ1klDc Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 0bc1c7a8029e4d40ac256dd2f877317b Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-VolumesActionsTest-312434626 Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:51:32.820363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:51:32.821715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0bc1c7a8029e4d40ac256dd2f877317b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bc1c7a8029e4d40ac256dd2f877317b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0bc1c7a8029e4d40ac256dd2f877317b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0bc1c7a8029e4d40ac256dd2f877317b", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:51:32.821715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-VolumesActionsTest-312434626 Jul 19 20:51:32.821715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 0bc1c7a8029e4d40ac256dd2f877317b Jul 19 20:51:32.821715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-VolumesActionsTest-312434626 Jul 19 20:51:32.821715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-VolumesActionsTest-312434626-project Jul 19 20:51:32.821715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:51:32.821715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:51:32.821715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: 6f3e4ee4b3ca492cabf2622f0659b5a5 Jul 19 20:51:32.821715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-VolumesActionsTest-312434626-project Jul 19 20:51:32.821715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:51:32.821715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance d8500d09-a98f-4348-bfdf-de65c829dadf could not be found. Jul 19 20:51:32.821715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': 'd8500d09-a98f-4348-bfdf-de65c829dadf'} Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8500d09-a98f-4348-bfdf-de65c829dadf could not be found. Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:51:32.822408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8500d09-a98f-4348-bfdf-de65c829dadf could not be found. Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8500d09-a98f-4348-bfdf-de65c829dadf could not be found. Jul 19 20:51:32.823589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:51:32.826522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7a0bbd3a-e727-4887-b87c-021911e5c564 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] Returning 404 to user: Instance d8500d09-a98f-4348-bfdf-de65c829dadf could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:51:32.826522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7a0bbd3a-e727-4887-b87c-021911e5c564 tempest-VolumesActionsTest-312434626 tempest-VolumesActionsTest-312434626-project] 10.222.0.70 "GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf" status: 404 len: 111 microversion: 2.1 time: 0.046488 Jul 19 20:51:32.826522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 179/388] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:32 2022] GET /compute/v2.1/servers/d8500d09-a98f-4348-bfdf-de65c829dadf => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:51:32.853351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e1929d78-8e3b-419d-bf6b-03ad74288f68 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:32.868928 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e1929d78-8e3b-419d-bf6b-03ad74288f68 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1370 microversion: 2.1 time: 0.255593 Jul 19 20:51:32.870204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 210/389] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:32 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:33.895612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2d35fbef-1978-463e-9e23-33973be90b2a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:33.897145 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2d35fbef-1978-463e-9e23-33973be90b2a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:33.913006 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d35fbef-1978-463e-9e23-33973be90b2a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:33.916342 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d35fbef-1978-463e-9e23-33973be90b2a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:33.918074 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d35fbef-1978-463e-9e23-33973be90b2a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:33.918892 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d35fbef-1978-463e-9e23-33973be90b2a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:34.151450 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2d35fbef-1978-463e-9e23-33973be90b2a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:51:34.160069 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2d35fbef-1978-463e-9e23-33973be90b2a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1564 microversion: 2.1 time: 0.272058 Jul 19 20:51:34.160654 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 180/390] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:51:33 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1564 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:51:34.183305 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6a7dcf6b-aaf9-41fb-a6ab-6f8e9ba01625 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:51:34.184169 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6a7dcf6b-aaf9-41fb-a6ab-6f8e9ba01625 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:51:34.192760 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6a7dcf6b-aaf9-41fb-a6ab-6f8e9ba01625 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:34.193450 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6a7dcf6b-aaf9-41fb-a6ab-6f8e9ba01625 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:34.194542 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6a7dcf6b-aaf9-41fb-a6ab-6f8e9ba01625 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:34.195082 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6a7dcf6b-aaf9-41fb-a6ab-6f8e9ba01625 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:34.336568 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6a7dcf6b-aaf9-41fb-a6ab-6f8e9ba01625 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157758 Jul 19 20:51:34.337644 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 211/391] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jul 19 20:51:34 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:51:35.504719 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-2b263d9a-01ef-49f4-8181-275dfbaeb4fb req-dc19f2f5-3169-41fc-97f3-e2b8b80c9cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272b6112-4d76-4d2f-84ab-4382b998c781", "tag": "c39b17d3-41ea-48aa-ace5-2a3ac46873d7"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:51:35.529986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-2b263d9a-01ef-49f4-8181-275dfbaeb4fb req-dc19f2f5-3169-41fc-97f3-e2b8b80c9cdf service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:51:35.535187 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-2b263d9a-01ef-49f4-8181-275dfbaeb4fb req-dc19f2f5-3169-41fc-97f3-e2b8b80c9cdf service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:51:35.557313 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-2b263d9a-01ef-49f4-8181-275dfbaeb4fb req-dc19f2f5-3169-41fc-97f3-e2b8b80c9cdf service nova] Creating event network-changed:c39b17d3-41ea-48aa-ace5-2a3ac46873d7 for instance 272b6112-4d76-4d2f-84ab-4382b998c781 on hv-cinder-79987 Jul 19 20:51:35.568049 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-2b263d9a-01ef-49f4-8181-275dfbaeb4fb req-dc19f2f5-3169-41fc-97f3-e2b8b80c9cdf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070649 Jul 19 20:51:35.569067 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 181/392] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:52:29.377661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:29.378838 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:29.385885 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c3e2f30d-0698-4613-99a1-206b72aca843 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:29.386700 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c3e2f30d-0698-4613-99a1-206b72aca843 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c3e2f30d-0698-4613-99a1-206b72aca843 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:29.398403 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c3e2f30d-0698-4613-99a1-206b72aca843 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:29.399276 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c3e2f30d-0698-4613-99a1-206b72aca843 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:29.399714 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c3e2f30d-0698-4613-99a1-206b72aca843 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:29.427141 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c3e2f30d-0698-4613-99a1-206b72aca843 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/ips" status: 200 len: 150 microversion: 2.1 time: 0.050960 Jul 19 20:52:29.427845 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 212/393] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jul 19 20:52:29 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:31.037636 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=33 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:31.038914 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=71 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:31.045957 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2c53b206-d80d-44fc-9987-2303cf7f9950 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a65addde-b40c-45a1-9d99-e93362c7223e"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:31.048520 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2c53b206-d80d-44fc-9987-2303cf7f9950 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:31.062302 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2c53b206-d80d-44fc-9987-2303cf7f9950 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:31.063098 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2c53b206-d80d-44fc-9987-2303cf7f9950 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:31.064521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2c53b206-d80d-44fc-9987-2303cf7f9950 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:31.065275 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2c53b206-d80d-44fc-9987-2303cf7f9950 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:31.377501 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2c53b206-d80d-44fc-9987-2303cf7f9950 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343141 Jul 19 20:52:31.378133 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 182/394] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 20:52:31 2022] POST /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:33.894174 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b4ad1bd0-75a1-41b4-872d-eaec492f4e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:33.895309 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b4ad1bd0-75a1-41b4-872d-eaec492f4e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:33.904993 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b4ad1bd0-75a1-41b4-872d-eaec492f4e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:33.906191 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b4ad1bd0-75a1-41b4-872d-eaec492f4e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:33.907512 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b4ad1bd0-75a1-41b4-872d-eaec492f4e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:33.908220 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b4ad1bd0-75a1-41b4-872d-eaec492f4e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:33.941905 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b4ad1bd0-75a1-41b4-872d-eaec492f4e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/ips" status: 200 len: 152 microversion: 2.20 time: 0.055244 Jul 19 20:52:33.942742 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 213/395] 10.222.0.70 () {60 vars in 1288 bytes} [Tue Jul 19 20:52:33 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/ips => generated 152 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:52:35.952695 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2a14e5bb-9dfc-4e3d-9c6c-059ff904b39e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:35.953574 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2a14e5bb-9dfc-4e3d-9c6c-059ff904b39e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:35.962518 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2a14e5bb-9dfc-4e3d-9c6c-059ff904b39e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:35.963131 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2a14e5bb-9dfc-4e3d-9c6c-059ff904b39e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:35.964113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2a14e5bb-9dfc-4e3d-9c6c-059ff904b39e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:35.964618 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2a14e5bb-9dfc-4e3d-9c6c-059ff904b39e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:35.992722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-2a14e5bb-9dfc-4e3d-9c6c-059ff904b39e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lazy-loading 'flavor' on Instance uuid 9e43f46e-319f-4ec4-8d5a-0e95995dc370 {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:52:36.366872 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2a14e5bb-9dfc-4e3d-9c6c-059ff904b39e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "POST /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/action" status: 202 len: 0 microversion: 2.20 time: 0.420564 Jul 19 20:52:36.367518 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 183/396] 10.222.0.70 () {62 vars in 1318 bytes} [Tue Jul 19 20:52:35 2022] POST /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:52:36.381908 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dbdd6900-80dc-4cb5-93bc-f3a0a5deb11b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:36.383280 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-dbdd6900-80dc-4cb5-93bc-f3a0a5deb11b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:36.396232 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dbdd6900-80dc-4cb5-93bc-f3a0a5deb11b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:36.397490 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dbdd6900-80dc-4cb5-93bc-f3a0a5deb11b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:36.397818 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dbdd6900-80dc-4cb5-93bc-f3a0a5deb11b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:36.398426 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dbdd6900-80dc-4cb5-93bc-f3a0a5deb11b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:36.818871 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dbdd6900-80dc-4cb5-93bc-f3a0a5deb11b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:36.831398 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dbdd6900-80dc-4cb5-93bc-f3a0a5deb11b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:36.833497 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dbdd6900-80dc-4cb5-93bc-f3a0a5deb11b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:36.834813 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dbdd6900-80dc-4cb5-93bc-f3a0a5deb11b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.461859 Jul 19 20:52:36.835551 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 214/397] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:36 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:52:37.862543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-43bdaf94-b361-47fd-bd1e-fea16a7a579a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:37.863792 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-43bdaf94-b361-47fd-bd1e-fea16a7a579a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:37.875501 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-43bdaf94-b361-47fd-bd1e-fea16a7a579a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:37.876804 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-43bdaf94-b361-47fd-bd1e-fea16a7a579a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:37.877743 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-43bdaf94-b361-47fd-bd1e-fea16a7a579a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:37.878546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-43bdaf94-b361-47fd-bd1e-fea16a7a579a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:38.054773 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-43bdaf94-b361-47fd-bd1e-fea16a7a579a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:38.066345 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-43bdaf94-b361-47fd-bd1e-fea16a7a579a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:38.068041 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-43bdaf94-b361-47fd-bd1e-fea16a7a579a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:38.069442 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-43bdaf94-b361-47fd-bd1e-fea16a7a579a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.216835 Jul 19 20:52:38.070015 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 184/398] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:37 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:52:38.235225 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:52:38.235516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Tue Jul 19 20:52:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:52:39.072452 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-aa29e768-b2a0-4baf-a7e3-86346790515a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: .version_select at 0x7f253425ce50>, body: {"keypair": {"name": "tempest-keypair-698271214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9IK+whzphAmR4VUADSJnN8o7SiAgDoxonG5c8D6DBOSWNff1pHTjyFjtVwwQTDsAn1h2D5J2/cTeSvYpPjit+BPMc9Ij79QBee9A/t/1aIdVsN1HY5iE0pkTjRe38Log=="}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:39.088788 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-aa29e768-b2a0-4baf-a7e3-86346790515a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for project 5da6c42976154440bd0459beb12477f2. Resources: {'key_pairs'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:52:39.094278 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-323f52d5-665f-4263-b9c1-176530e7c974 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:39.096451 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-323f52d5-665f-4263-b9c1-176530e7c974 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:39.107690 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-aa29e768-b2a0-4baf-a7e3-86346790515a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for user af989ff6dc024ff19023e6f633915ec3 and project 5da6c42976154440bd0459beb12477f2. Resources: {'key_pairs'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:52:39.109349 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-323f52d5-665f-4263-b9c1-176530e7c974 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:39.110922 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-323f52d5-665f-4263-b9c1-176530e7c974 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:39.113032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-323f52d5-665f-4263-b9c1-176530e7c974 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:39.114715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-323f52d5-665f-4263-b9c1-176530e7c974 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:39.141064 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-aa29e768-b2a0-4baf-a7e3-86346790515a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071194 Jul 19 20:52:39.142620 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 215/399] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jul 19 20:52:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:52:39.380447 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-323f52d5-665f-4263-b9c1-176530e7c974 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:39.393866 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-323f52d5-665f-4263-b9c1-176530e7c974 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:39.395424 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-323f52d5-665f-4263-b9c1-176530e7c974 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:39.396786 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-323f52d5-665f-4263-b9c1-176530e7c974 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.310278 Jul 19 20:52:39.397393 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 185/400] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:39 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:52:40.424645 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-fb590c27-7b75-42fc-9fbd-796c53325d45 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:40.425561 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-fb590c27-7b75-42fc-9fbd-796c53325d45 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:40.432134 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb590c27-7b75-42fc-9fbd-796c53325d45 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:40.432585 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb590c27-7b75-42fc-9fbd-796c53325d45 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:40.433414 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb590c27-7b75-42fc-9fbd-796c53325d45 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:40.433854 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb590c27-7b75-42fc-9fbd-796c53325d45 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:40.713141 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-fb590c27-7b75-42fc-9fbd-796c53325d45 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:40.729184 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-fb590c27-7b75-42fc-9fbd-796c53325d45 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:40.732416 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-fb590c27-7b75-42fc-9fbd-796c53325d45 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:40.734783 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-fb590c27-7b75-42fc-9fbd-796c53325d45 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.314847 Jul 19 20:52:40.735827 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 216/401] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:40 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:52:41.252350 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-639286431", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4988720a-c392-40ae-8d35-c194234e1fb1"}], "security_groups": [{"name": "tempest-securitygroup--523722630"}], "key_name": "tempest-keypair-698271214", "user_data": "}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:41.397585 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.network.neutron [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] validate_networks() for [('4988720a-c392-40ae-8d35-c194234e1fb1', None, None, None, None, None)] {{(pid=129867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:52:41.769571 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-24356fd0-8c38-471f-a890-1186e612b006 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:41.770834 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-24356fd0-8c38-471f-a890-1186e612b006 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:41.782464 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-24356fd0-8c38-471f-a890-1186e612b006 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:41.783636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-24356fd0-8c38-471f-a890-1186e612b006 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:41.786751 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-24356fd0-8c38-471f-a890-1186e612b006 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:41.786751 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-24356fd0-8c38-471f-a890-1186e612b006 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:42.002535 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Flavor limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:52:42.003294 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Image limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:52:42.004393 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Flavor pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:52:42.005235 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Image pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:52:42.005734 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:52:42.021926 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:42.022607 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:42.023857 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:42.024533 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:42.050544 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-24356fd0-8c38-471f-a890-1186e612b006 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:42.052506 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for project 5da6c42976154440bd0459beb12477f2. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:52:42.059098 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for user af989ff6dc024ff19023e6f633915ec3 and project 5da6c42976154440bd0459beb12477f2. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:52:42.066920 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-24356fd0-8c38-471f-a890-1186e612b006 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:42.069994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-24356fd0-8c38-471f-a890-1186e612b006 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:42.072320 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-24356fd0-8c38-471f-a890-1186e612b006 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.310749 Jul 19 20:52:42.073197 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 217/402] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:41 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:52:42.078613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Going to run 1 instances... {{(pid=129867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:52:42.082326 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:52:42.141352 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-76785c6e-25c7-4137-b316-e0156a1a3570 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.892999 Jul 19 20:52:42.142581 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 186/403] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:52:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:52:42.159556 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5d0680a2-ef9e-4833-a183-b6543015eec4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:42.161096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5d0680a2-ef9e-4833-a183-b6543015eec4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:42.255831 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5d0680a2-ef9e-4833-a183-b6543015eec4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:42.269006 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5d0680a2-ef9e-4833-a183-b6543015eec4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1240 microversion: 2.1 time: 0.116281 Jul 19 20:52:42.270032 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 218/404] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:42 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:43.099564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-88c3d704-8b44-4a7a-9a1d-95f9e80e1058 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:43.100593 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-88c3d704-8b44-4a7a-9a1d-95f9e80e1058 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:43.112749 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-88c3d704-8b44-4a7a-9a1d-95f9e80e1058 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:43.113268 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-88c3d704-8b44-4a7a-9a1d-95f9e80e1058 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:43.114386 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-88c3d704-8b44-4a7a-9a1d-95f9e80e1058 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:43.115000 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-88c3d704-8b44-4a7a-9a1d-95f9e80e1058 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:43.298156 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3e43e57b-4484-4d38-867f-7ebf93e83b80 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:43.299295 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3e43e57b-4484-4d38-867f-7ebf93e83b80 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:43.308488 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3e43e57b-4484-4d38-867f-7ebf93e83b80 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:43.309204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3e43e57b-4484-4d38-867f-7ebf93e83b80 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:43.310737 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3e43e57b-4484-4d38-867f-7ebf93e83b80 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:43.312387 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3e43e57b-4484-4d38-867f-7ebf93e83b80 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:43.341856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-88c3d704-8b44-4a7a-9a1d-95f9e80e1058 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:43.354819 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-88c3d704-8b44-4a7a-9a1d-95f9e80e1058 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:43.356545 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-88c3d704-8b44-4a7a-9a1d-95f9e80e1058 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:43.357848 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-88c3d704-8b44-4a7a-9a1d-95f9e80e1058 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.267926 Jul 19 20:52:43.358448 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 187/405] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:43 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:52:43.403888 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3e43e57b-4484-4d38-867f-7ebf93e83b80 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:43.419459 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3e43e57b-4484-4d38-867f-7ebf93e83b80 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1292 microversion: 2.1 time: 0.127239 Jul 19 20:52:43.420344 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 219/406] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:43 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1292 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:44.383167 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-88bdc00d-aa69-4fe8-8c45-de7d2e9092d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:44.384299 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-88bdc00d-aa69-4fe8-8c45-de7d2e9092d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:44.397175 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-88bdc00d-aa69-4fe8-8c45-de7d2e9092d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:44.398763 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-88bdc00d-aa69-4fe8-8c45-de7d2e9092d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:44.398977 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-88bdc00d-aa69-4fe8-8c45-de7d2e9092d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:44.399540 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-88bdc00d-aa69-4fe8-8c45-de7d2e9092d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:44.449868 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-aeaedcfa-1a0a-407e-893b-de4428d85c1b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:44.451086 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-aeaedcfa-1a0a-407e-893b-de4428d85c1b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:44.463129 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aeaedcfa-1a0a-407e-893b-de4428d85c1b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:44.463782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aeaedcfa-1a0a-407e-893b-de4428d85c1b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:44.465433 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aeaedcfa-1a0a-407e-893b-de4428d85c1b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:44.466219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aeaedcfa-1a0a-407e-893b-de4428d85c1b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:44.565140 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-aeaedcfa-1a0a-407e-893b-de4428d85c1b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:44.579832 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-aeaedcfa-1a0a-407e-893b-de4428d85c1b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1298 microversion: 2.1 time: 0.137225 Jul 19 20:52:44.580630 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 220/407] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:44 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1298 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:44.659714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-88bdc00d-aa69-4fe8-8c45-de7d2e9092d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:44.674779 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-88bdc00d-aa69-4fe8-8c45-de7d2e9092d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:44.678579 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-88bdc00d-aa69-4fe8-8c45-de7d2e9092d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:44.680397 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-88bdc00d-aa69-4fe8-8c45-de7d2e9092d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.306511 Jul 19 20:52:44.682766 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 188/408] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:44 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:52:45.606077 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-847071d5-91be-4118-ab17-3554f037e48c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:45.606995 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-847071d5-91be-4118-ab17-3554f037e48c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:45.615445 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-847071d5-91be-4118-ab17-3554f037e48c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:45.615906 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-847071d5-91be-4118-ab17-3554f037e48c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:45.616914 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-847071d5-91be-4118-ab17-3554f037e48c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:45.617396 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-847071d5-91be-4118-ab17-3554f037e48c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:45.714138 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7e1e4740-4489-4a05-af00-7624ace4da80 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:45.716084 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7e1e4740-4489-4a05-af00-7624ace4da80 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:45.728293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7e1e4740-4489-4a05-af00-7624ace4da80 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:45.729110 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7e1e4740-4489-4a05-af00-7624ace4da80 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:45.730660 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7e1e4740-4489-4a05-af00-7624ace4da80 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:45.731448 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7e1e4740-4489-4a05-af00-7624ace4da80 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:45.863254 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-847071d5-91be-4118-ab17-3554f037e48c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:45.910262 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-847071d5-91be-4118-ab17-3554f037e48c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1365 microversion: 2.1 time: 0.304671 Jul 19 20:52:45.912005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 221/409] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:45 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:45.924376 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-a71a540f-619a-4a5f-bea9-e82611931a5d req-01b1eaf3-3882-49d8-936a-d320bca5ee11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30f2c53f-06f9-4306-82e4-df8af346dbab", "tag": "25c1ba5d-6162-4252-a7d2-1fc981c53132"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:45.946283 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-a71a540f-619a-4a5f-bea9-e82611931a5d req-01b1eaf3-3882-49d8-936a-d320bca5ee11 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:45.947769 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-a71a540f-619a-4a5f-bea9-e82611931a5d req-01b1eaf3-3882-49d8-936a-d320bca5ee11 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:45.981010 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-a71a540f-619a-4a5f-bea9-e82611931a5d req-01b1eaf3-3882-49d8-936a-d320bca5ee11 service nova] Creating event network-changed:25c1ba5d-6162-4252-a7d2-1fc981c53132 for instance 30f2c53f-06f9-4306-82e4-df8af346dbab on hv-cinder-79987 Jul 19 20:52:45.992519 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-a71a540f-619a-4a5f-bea9-e82611931a5d req-01b1eaf3-3882-49d8-936a-d320bca5ee11 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077439 Jul 19 20:52:45.994094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 222/410] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:46.024354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7e1e4740-4489-4a05-af00-7624ace4da80 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:46.039845 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7e1e4740-4489-4a05-af00-7624ace4da80 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:46.043360 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7e1e4740-4489-4a05-af00-7624ace4da80 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:46.046708 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7e1e4740-4489-4a05-af00-7624ace4da80 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.339102 Jul 19 20:52:46.062796 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 189/411] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:45 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:52:46.943246 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5dfce229-f344-4a23-bce8-196d87e63e69 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:46.943958 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5dfce229-f344-4a23-bce8-196d87e63e69 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:46.953297 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5dfce229-f344-4a23-bce8-196d87e63e69 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:46.954089 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5dfce229-f344-4a23-bce8-196d87e63e69 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:46.955010 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5dfce229-f344-4a23-bce8-196d87e63e69 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:46.955458 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5dfce229-f344-4a23-bce8-196d87e63e69 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:47.078307 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-42f93495-a804-4a5e-8974-ab5e1ccc4e6c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:47.079107 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-42f93495-a804-4a5e-8974-ab5e1ccc4e6c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:47.088360 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-42f93495-a804-4a5e-8974-ab5e1ccc4e6c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:47.089478 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-42f93495-a804-4a5e-8974-ab5e1ccc4e6c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:47.090497 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-42f93495-a804-4a5e-8974-ab5e1ccc4e6c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:47.090952 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-42f93495-a804-4a5e-8974-ab5e1ccc4e6c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:47.098411 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5dfce229-f344-4a23-bce8-196d87e63e69 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:47.106241 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5dfce229-f344-4a23-bce8-196d87e63e69 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1365 microversion: 2.1 time: 0.171831 Jul 19 20:52:47.106980 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 223/412] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:46 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:47.237965 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-42f93495-a804-4a5e-8974-ab5e1ccc4e6c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:47.246695 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-42f93495-a804-4a5e-8974-ab5e1ccc4e6c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:47.248211 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-42f93495-a804-4a5e-8974-ab5e1ccc4e6c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:47.249386 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-42f93495-a804-4a5e-8974-ab5e1ccc4e6c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.175563 Jul 19 20:52:47.249942 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 190/413] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:47 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:52:48.124473 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-58a333fc-cf79-46d0-972d-cb2804dcf14d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:48.125126 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-58a333fc-cf79-46d0-972d-cb2804dcf14d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:48.132133 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-58a333fc-cf79-46d0-972d-cb2804dcf14d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:48.132653 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-58a333fc-cf79-46d0-972d-cb2804dcf14d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:48.133516 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-58a333fc-cf79-46d0-972d-cb2804dcf14d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:48.133994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-58a333fc-cf79-46d0-972d-cb2804dcf14d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:48.271185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e1d97c59-e4a4-4b21-91c5-8d1b6f144d56 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:48.272269 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e1d97c59-e4a4-4b21-91c5-8d1b6f144d56 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:48.279991 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e1d97c59-e4a4-4b21-91c5-8d1b6f144d56 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:48.281013 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e1d97c59-e4a4-4b21-91c5-8d1b6f144d56 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:48.281851 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e1d97c59-e4a4-4b21-91c5-8d1b6f144d56 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:48.282290 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e1d97c59-e4a4-4b21-91c5-8d1b6f144d56 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:48.328123 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-58a333fc-cf79-46d0-972d-cb2804dcf14d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:48.343199 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-58a333fc-cf79-46d0-972d-cb2804dcf14d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1365 microversion: 2.1 time: 0.221731 Jul 19 20:52:48.344371 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 224/414] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:48 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:52:48.446531 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e1d97c59-e4a4-4b21-91c5-8d1b6f144d56 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:48.458486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e1d97c59-e4a4-4b21-91c5-8d1b6f144d56 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:48.461420 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e1d97c59-e4a4-4b21-91c5-8d1b6f144d56 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:48.463509 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e1d97c59-e4a4-4b21-91c5-8d1b6f144d56 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.197973 Jul 19 20:52:48.464178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 191/415] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:48 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:52:49.364476 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b32da2d8-c65b-4f2d-a319-8038a383dd94 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:49.365123 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b32da2d8-c65b-4f2d-a319-8038a383dd94 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:49.375895 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b32da2d8-c65b-4f2d-a319-8038a383dd94 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:49.376705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b32da2d8-c65b-4f2d-a319-8038a383dd94 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:49.377982 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b32da2d8-c65b-4f2d-a319-8038a383dd94 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:49.378566 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b32da2d8-c65b-4f2d-a319-8038a383dd94 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:49.485154 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-134fb655-eed9-44c0-99fe-93d9ca07825b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:49.486055 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-134fb655-eed9-44c0-99fe-93d9ca07825b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:49.496022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-134fb655-eed9-44c0-99fe-93d9ca07825b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:49.496884 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-134fb655-eed9-44c0-99fe-93d9ca07825b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:49.498686 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-134fb655-eed9-44c0-99fe-93d9ca07825b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:49.500522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-134fb655-eed9-44c0-99fe-93d9ca07825b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:49.632881 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b32da2d8-c65b-4f2d-a319-8038a383dd94 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:49.647617 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b32da2d8-c65b-4f2d-a319-8038a383dd94 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1365 microversion: 2.1 time: 0.288692 Jul 19 20:52:49.648656 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 225/416] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:49 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:49.734190 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-134fb655-eed9-44c0-99fe-93d9ca07825b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:49.749688 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-134fb655-eed9-44c0-99fe-93d9ca07825b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:49.752959 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-134fb655-eed9-44c0-99fe-93d9ca07825b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:49.755264 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-134fb655-eed9-44c0-99fe-93d9ca07825b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.274688 Jul 19 20:52:49.756433 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 192/417] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:49 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:52:50.678807 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-804442e4-4ba0-4ad2-8e2b-87016b7fed2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:50.679689 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-804442e4-4ba0-4ad2-8e2b-87016b7fed2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:50.688090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-804442e4-4ba0-4ad2-8e2b-87016b7fed2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:50.688550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-804442e4-4ba0-4ad2-8e2b-87016b7fed2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:50.690011 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-804442e4-4ba0-4ad2-8e2b-87016b7fed2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:50.690195 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-804442e4-4ba0-4ad2-8e2b-87016b7fed2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:50.788111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-468ab458-5336-4d82-8c89-907010af2259 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:50.789234 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-468ab458-5336-4d82-8c89-907010af2259 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:50.800384 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-468ab458-5336-4d82-8c89-907010af2259 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:50.801150 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-468ab458-5336-4d82-8c89-907010af2259 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:50.802478 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-468ab458-5336-4d82-8c89-907010af2259 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:50.803282 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-468ab458-5336-4d82-8c89-907010af2259 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:50.878476 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-804442e4-4ba0-4ad2-8e2b-87016b7fed2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:50.887465 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-804442e4-4ba0-4ad2-8e2b-87016b7fed2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1365 microversion: 2.1 time: 0.214012 Jul 19 20:52:50.888365 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 226/418] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:50 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:51.023122 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-468ab458-5336-4d82-8c89-907010af2259 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:51.033610 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-468ab458-5336-4d82-8c89-907010af2259 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:51.036068 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-468ab458-5336-4d82-8c89-907010af2259 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:51.037628 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-468ab458-5336-4d82-8c89-907010af2259 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.256881 Jul 19 20:52:51.038464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 193/419] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:50 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:52:51.913560 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-168c3941-73de-4e2e-9f7c-f2936b8f6f04 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:51.914530 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-168c3941-73de-4e2e-9f7c-f2936b8f6f04 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:51.922791 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-168c3941-73de-4e2e-9f7c-f2936b8f6f04 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:51.923248 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-168c3941-73de-4e2e-9f7c-f2936b8f6f04 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:51.924052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-168c3941-73de-4e2e-9f7c-f2936b8f6f04 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:51.924493 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-168c3941-73de-4e2e-9f7c-f2936b8f6f04 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:52.071570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-3558aadb-1756-4605-9b49-2b2ea125a8d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:52.072842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-3558aadb-1756-4605-9b49-2b2ea125a8d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:52.077197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:52.078391 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=6 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:52.086245 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-168c3941-73de-4e2e-9f7c-f2936b8f6f04 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:52.087173 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3558aadb-1756-4605-9b49-2b2ea125a8d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:52.087695 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3558aadb-1756-4605-9b49-2b2ea125a8d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:52.088951 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3558aadb-1756-4605-9b49-2b2ea125a8d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:52.089623 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3558aadb-1756-4605-9b49-2b2ea125a8d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:52.102139 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-168c3941-73de-4e2e-9f7c-f2936b8f6f04 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1365 microversion: 2.1 time: 0.193093 Jul 19 20:52:52.104276 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 227/420] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:51 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:52.243544 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3558aadb-1756-4605-9b49-2b2ea125a8d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:52.255190 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3558aadb-1756-4605-9b49-2b2ea125a8d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:52.256955 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3558aadb-1756-4605-9b49-2b2ea125a8d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:52.258581 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-3558aadb-1756-4605-9b49-2b2ea125a8d1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.195568 Jul 19 20:52:52.259148 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 194/421] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:52 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:52:53.120281 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-68822188-48ba-4c5a-85b7-34aa8a30d7ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:53.120996 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-68822188-48ba-4c5a-85b7-34aa8a30d7ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:53.123045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=6 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:53.131348 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-68822188-48ba-4c5a-85b7-34aa8a30d7ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:53.131829 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-68822188-48ba-4c5a-85b7-34aa8a30d7ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:53.132720 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-68822188-48ba-4c5a-85b7-34aa8a30d7ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:53.133251 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-68822188-48ba-4c5a-85b7-34aa8a30d7ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:53.278266 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-1f01d021-71ae-40ee-8139-93c2ab95b2c9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:53.278990 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-1f01d021-71ae-40ee-8139-93c2ab95b2c9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:53.286794 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1f01d021-71ae-40ee-8139-93c2ab95b2c9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:53.287263 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1f01d021-71ae-40ee-8139-93c2ab95b2c9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:53.288057 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1f01d021-71ae-40ee-8139-93c2ab95b2c9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:53.288499 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1f01d021-71ae-40ee-8139-93c2ab95b2c9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:53.320378 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-68822188-48ba-4c5a-85b7-34aa8a30d7ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:53.329647 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-68822188-48ba-4c5a-85b7-34aa8a30d7ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1365 microversion: 2.1 time: 0.213113 Jul 19 20:52:53.330200 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 228/422] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:53 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:53.453071 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1f01d021-71ae-40ee-8139-93c2ab95b2c9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:53.457197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:53.464322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1f01d021-71ae-40ee-8139-93c2ab95b2c9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:53.465990 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1f01d021-71ae-40ee-8139-93c2ab95b2c9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:53.467226 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-1f01d021-71ae-40ee-8139-93c2ab95b2c9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.192950 Jul 19 20:52:53.467780 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 195/423] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:53 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:52:53.657705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-6531b654-3c16-4330-80da-6e95ce28d7bd req-2886e480-13a9-43b2-841e-c7d8df9a5f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f2c53f-06f9-4306-82e4-df8af346dbab", "name": "network-vif-plugged", "status": "completed", "tag": "25c1ba5d-6162-4252-a7d2-1fc981c53132"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:53.669351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-6531b654-3c16-4330-80da-6e95ce28d7bd req-2886e480-13a9-43b2-841e-c7d8df9a5f69 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:53.669805 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-6531b654-3c16-4330-80da-6e95ce28d7bd req-2886e480-13a9-43b2-841e-c7d8df9a5f69 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:53.689283 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-6531b654-3c16-4330-80da-6e95ce28d7bd req-2886e480-13a9-43b2-841e-c7d8df9a5f69 service nova] Creating event network-vif-plugged:25c1ba5d-6162-4252-a7d2-1fc981c53132 for instance 30f2c53f-06f9-4306-82e4-df8af346dbab on hv-cinder-79987 Jul 19 20:52:53.695262 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-6531b654-3c16-4330-80da-6e95ce28d7bd req-2886e480-13a9-43b2-841e-c7d8df9a5f69 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043783 Jul 19 20:52:53.695867 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 229/424] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:54.356602 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-63b69c4b-3413-4d42-9e13-ebe470e921f3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:54.357351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-63b69c4b-3413-4d42-9e13-ebe470e921f3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:54.368098 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-63b69c4b-3413-4d42-9e13-ebe470e921f3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:54.368098 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-63b69c4b-3413-4d42-9e13-ebe470e921f3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:54.368098 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-63b69c4b-3413-4d42-9e13-ebe470e921f3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:54.368713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-63b69c4b-3413-4d42-9e13-ebe470e921f3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:54.499142 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6fbeefc4-8980-4775-9106-85110c237bfb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:54.500051 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6fbeefc4-8980-4775-9106-85110c237bfb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:54.508748 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6fbeefc4-8980-4775-9106-85110c237bfb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:54.509228 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6fbeefc4-8980-4775-9106-85110c237bfb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:54.510252 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6fbeefc4-8980-4775-9106-85110c237bfb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:54.510767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6fbeefc4-8980-4775-9106-85110c237bfb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:54.585882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-63b69c4b-3413-4d42-9e13-ebe470e921f3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:54.601151 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-63b69c4b-3413-4d42-9e13-ebe470e921f3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1365 microversion: 2.1 time: 0.248379 Jul 19 20:52:54.602287 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 196/425] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:54 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:54.731176 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6fbeefc4-8980-4775-9106-85110c237bfb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:54.747602 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6fbeefc4-8980-4775-9106-85110c237bfb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:54.750981 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6fbeefc4-8980-4775-9106-85110c237bfb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:54.753344 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6fbeefc4-8980-4775-9106-85110c237bfb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1741 microversion: 2.20 time: 0.260367 Jul 19 20:52:54.754410 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 230/426] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:54 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:52:55.622688 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b3af12fa-84c8-441e-901c-1de77c1c1f37 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:55.623535 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b3af12fa-84c8-441e-901c-1de77c1c1f37 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:55.635025 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b3af12fa-84c8-441e-901c-1de77c1c1f37 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:55.635791 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b3af12fa-84c8-441e-901c-1de77c1c1f37 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:55.637109 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b3af12fa-84c8-441e-901c-1de77c1c1f37 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:55.637712 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b3af12fa-84c8-441e-901c-1de77c1c1f37 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:55.787949 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-da9aa0c5-e680-40f5-97ab-bcef24fe1b37 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:55.789385 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-da9aa0c5-e680-40f5-97ab-bcef24fe1b37 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:55.796991 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-da9aa0c5-e680-40f5-97ab-bcef24fe1b37 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:55.798117 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-da9aa0c5-e680-40f5-97ab-bcef24fe1b37 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:55.799179 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-da9aa0c5-e680-40f5-97ab-bcef24fe1b37 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:55.799791 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-da9aa0c5-e680-40f5-97ab-bcef24fe1b37 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:55.860822 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b3af12fa-84c8-441e-901c-1de77c1c1f37 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:55.875271 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b3af12fa-84c8-441e-901c-1de77c1c1f37 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1365 microversion: 2.1 time: 0.258190 Jul 19 20:52:55.876373 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 197/427] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:55 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:55.996162 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-da9aa0c5-e680-40f5-97ab-bcef24fe1b37 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:56.008107 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-da9aa0c5-e680-40f5-97ab-bcef24fe1b37 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:56.010209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-da9aa0c5-e680-40f5-97ab-bcef24fe1b37 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:56.011535 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-da9aa0c5-e680-40f5-97ab-bcef24fe1b37 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1741 microversion: 2.20 time: 0.229170 Jul 19 20:52:56.012108 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 231/428] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:55 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:52:56.904560 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-3298e791-c7db-41bb-a280-8691047276bc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:56.906343 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-3298e791-c7db-41bb-a280-8691047276bc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:56.914608 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3298e791-c7db-41bb-a280-8691047276bc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:56.914608 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3298e791-c7db-41bb-a280-8691047276bc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:56.915565 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3298e791-c7db-41bb-a280-8691047276bc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:56.916052 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3298e791-c7db-41bb-a280-8691047276bc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:57.033107 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-23c28b14-5755-4079-8262-c53e3846f4b0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:57.034002 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-23c28b14-5755-4079-8262-c53e3846f4b0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:57.041122 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-23c28b14-5755-4079-8262-c53e3846f4b0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:57.041617 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-23c28b14-5755-4079-8262-c53e3846f4b0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:57.042400 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-23c28b14-5755-4079-8262-c53e3846f4b0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:57.042834 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-23c28b14-5755-4079-8262-c53e3846f4b0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:57.079192 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=100 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:57.107866 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3298e791-c7db-41bb-a280-8691047276bc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:57.118056 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-3298e791-c7db-41bb-a280-8691047276bc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1555 microversion: 2.1 time: 0.218681 Jul 19 20:52:57.118927 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 198/429] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:52:56 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:57.142946 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5f17afc8-bd79-455e-9949-75ecc73c7e3a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:57.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5f17afc8-bd79-455e-9949-75ecc73c7e3a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:57.153695 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5f17afc8-bd79-455e-9949-75ecc73c7e3a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:57.154163 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5f17afc8-bd79-455e-9949-75ecc73c7e3a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:57.155032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5f17afc8-bd79-455e-9949-75ecc73c7e3a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:57.155932 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5f17afc8-bd79-455e-9949-75ecc73c7e3a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:57.278192 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5f17afc8-bd79-455e-9949-75ecc73c7e3a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143153 Jul 19 20:52:57.278786 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 199/430] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jul 19 20:52:57 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:52:57.282421 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-23c28b14-5755-4079-8262-c53e3846f4b0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:57.291823 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-23c28b14-5755-4079-8262-c53e3846f4b0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:57.293805 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-23c28b14-5755-4079-8262-c53e3846f4b0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:57.296070 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-23c28b14-5755-4079-8262-c53e3846f4b0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1741 microversion: 2.20 time: 0.268097 Jul 19 20:52:57.296944 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 232/431] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:57 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1741 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:52:57.659949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-45e34037-1808-445b-9cfa-6ff0d04d106a req-9ecd0725-becf-40e3-af97-59914ec80daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e43f46e-319f-4ec4-8d5a-0e95995dc370", "name": "network-vif-plugged", "status": "completed", "tag": "8f0876b6-27aa-4999-81eb-a3e576f37753"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:57.675243 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-45e34037-1808-445b-9cfa-6ff0d04d106a req-9ecd0725-becf-40e3-af97-59914ec80daa service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:57.676418 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-45e34037-1808-445b-9cfa-6ff0d04d106a req-9ecd0725-becf-40e3-af97-59914ec80daa service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:57.699309 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-45e34037-1808-445b-9cfa-6ff0d04d106a req-9ecd0725-becf-40e3-af97-59914ec80daa service nova] Creating event network-vif-plugged:8f0876b6-27aa-4999-81eb-a3e576f37753 for instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 on hv-cinder-79987 Jul 19 20:52:57.709189 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-45e34037-1808-445b-9cfa-6ff0d04d106a req-9ecd0725-becf-40e3-af97-59914ec80daa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055904 Jul 19 20:52:57.710708 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 200/432] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:58.321661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9eb4edc3-09e8-4472-a9f4-6e59c0e255f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:58.322793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-9eb4edc3-09e8-4472-a9f4-6e59c0e255f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:58.334082 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9eb4edc3-09e8-4472-a9f4-6e59c0e255f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:58.334904 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9eb4edc3-09e8-4472-a9f4-6e59c0e255f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:58.336372 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9eb4edc3-09e8-4472-a9f4-6e59c0e255f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:58.337165 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9eb4edc3-09e8-4472-a9f4-6e59c0e255f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:58.699369 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9eb4edc3-09e8-4472-a9f4-6e59c0e255f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:58.715432 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9eb4edc3-09e8-4472-a9f4-6e59c0e255f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:58.719647 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9eb4edc3-09e8-4472-a9f4-6e59c0e255f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:52:58.722832 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9eb4edc3-09e8-4472-a9f4-6e59c0e255f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1741 microversion: 2.20 time: 0.408963 Jul 19 20:52:58.725198 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 233/433] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:58 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1741 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:52:58.915060 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-93861d7a-ce97-429a-b366-1c313f5e0e85 req-394b8047-18e9-47a8-ac45-8c30e9a48c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30f2c53f-06f9-4306-82e4-df8af346dbab", "tag": "25c1ba5d-6162-4252-a7d2-1fc981c53132"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:52:58.931229 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-93861d7a-ce97-429a-b366-1c313f5e0e85 req-394b8047-18e9-47a8-ac45-8c30e9a48c1f service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:58.932141 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-93861d7a-ce97-429a-b366-1c313f5e0e85 req-394b8047-18e9-47a8-ac45-8c30e9a48c1f service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:58.947786 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-93861d7a-ce97-429a-b366-1c313f5e0e85 req-394b8047-18e9-47a8-ac45-8c30e9a48c1f service nova] Creating event network-changed:25c1ba5d-6162-4252-a7d2-1fc981c53132 for instance 30f2c53f-06f9-4306-82e4-df8af346dbab on hv-cinder-79987 Jul 19 20:52:58.954080 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-93861d7a-ce97-429a-b366-1c313f5e0e85 req-394b8047-18e9-47a8-ac45-8c30e9a48c1f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047633 Jul 19 20:52:58.954700 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 201/434] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:59.753408 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-36bf83e0-0cbc-4bb6-9c3d-0b8675673cdd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:59.754310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-36bf83e0-0cbc-4bb6-9c3d-0b8675673cdd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:52:59.763942 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:59.768277 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-36bf83e0-0cbc-4bb6-9c3d-0b8675673cdd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:59.768833 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-36bf83e0-0cbc-4bb6-9c3d-0b8675673cdd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:59.770161 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-36bf83e0-0cbc-4bb6-9c3d-0b8675673cdd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:59.771000 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-36bf83e0-0cbc-4bb6-9c3d-0b8675673cdd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:00.030496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-36bf83e0-0cbc-4bb6-9c3d-0b8675673cdd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:00.048038 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-36bf83e0-0cbc-4bb6-9c3d-0b8675673cdd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:00.051716 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-36bf83e0-0cbc-4bb6-9c3d-0b8675673cdd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:00.054049 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-36bf83e0-0cbc-4bb6-9c3d-0b8675673cdd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1741 microversion: 2.20 time: 0.308905 Jul 19 20:53:00.055042 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 234/435] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:52:59 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1741 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:01.081647 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-96c3f634-a305-44d2-a988-82d8bf6e61bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:01.082360 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-96c3f634-a305-44d2-a988-82d8bf6e61bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:01.084386 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:01.090360 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-96c3f634-a305-44d2-a988-82d8bf6e61bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:01.090851 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-96c3f634-a305-44d2-a988-82d8bf6e61bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:01.091635 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-96c3f634-a305-44d2-a988-82d8bf6e61bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:01.092080 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-96c3f634-a305-44d2-a988-82d8bf6e61bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:01.250835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-96c3f634-a305-44d2-a988-82d8bf6e61bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:01.259394 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-96c3f634-a305-44d2-a988-82d8bf6e61bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:01.260917 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-96c3f634-a305-44d2-a988-82d8bf6e61bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:01.262136 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-96c3f634-a305-44d2-a988-82d8bf6e61bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1741 microversion: 2.20 time: 0.186818 Jul 19 20:53:01.262703 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 202/436] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:01 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:02.293131 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b757a78f-2efa-41a0-9438-9ef524e6cd44 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:02.294004 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b757a78f-2efa-41a0-9438-9ef524e6cd44 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:02.301095 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b757a78f-2efa-41a0-9438-9ef524e6cd44 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:02.301589 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b757a78f-2efa-41a0-9438-9ef524e6cd44 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:02.302395 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b757a78f-2efa-41a0-9438-9ef524e6cd44 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:02.302917 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b757a78f-2efa-41a0-9438-9ef524e6cd44 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:02.606614 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b757a78f-2efa-41a0-9438-9ef524e6cd44 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:02.641406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b757a78f-2efa-41a0-9438-9ef524e6cd44 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:02.641406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b757a78f-2efa-41a0-9438-9ef524e6cd44 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:02.647801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b757a78f-2efa-41a0-9438-9ef524e6cd44 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1736 microversion: 2.20 time: 0.359224 Jul 19 20:53:02.669394 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 235/437] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:02 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1736 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:03.695222 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-648243ca-d28d-42e4-90ad-b01c235a4eb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:03.696523 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-648243ca-d28d-42e4-90ad-b01c235a4eb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:03.704532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-648243ca-d28d-42e4-90ad-b01c235a4eb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:03.705313 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-648243ca-d28d-42e4-90ad-b01c235a4eb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:03.706753 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-648243ca-d28d-42e4-90ad-b01c235a4eb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:03.706753 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-648243ca-d28d-42e4-90ad-b01c235a4eb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:03.939545 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-648243ca-d28d-42e4-90ad-b01c235a4eb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:03.958041 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-648243ca-d28d-42e4-90ad-b01c235a4eb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:03.966301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-648243ca-d28d-42e4-90ad-b01c235a4eb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:03.971207 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-648243ca-d28d-42e4-90ad-b01c235a4eb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1736 microversion: 2.20 time: 0.283892 Jul 19 20:53:03.972141 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 203/438] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:03 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1736 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:05.000706 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f5b9240f-bdc8-4dfe-b755-41fb767d973a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:05.001592 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f5b9240f-bdc8-4dfe-b755-41fb767d973a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:05.008341 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f5b9240f-bdc8-4dfe-b755-41fb767d973a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:05.008793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f5b9240f-bdc8-4dfe-b755-41fb767d973a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:05.009629 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f5b9240f-bdc8-4dfe-b755-41fb767d973a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:05.010082 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f5b9240f-bdc8-4dfe-b755-41fb767d973a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:05.221737 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f5b9240f-bdc8-4dfe-b755-41fb767d973a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:05.236494 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f5b9240f-bdc8-4dfe-b755-41fb767d973a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:05.238252 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f5b9240f-bdc8-4dfe-b755-41fb767d973a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:05.239574 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f5b9240f-bdc8-4dfe-b755-41fb767d973a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1736 microversion: 2.20 time: 0.244161 Jul 19 20:53:05.240784 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 236/439] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:04 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:06.275123 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-54bd2f35-1888-4e0c-b6fc-ca83bec21a31 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:06.276033 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-54bd2f35-1888-4e0c-b6fc-ca83bec21a31 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:06.291282 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-54bd2f35-1888-4e0c-b6fc-ca83bec21a31 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:06.292897 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-54bd2f35-1888-4e0c-b6fc-ca83bec21a31 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:06.297132 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-54bd2f35-1888-4e0c-b6fc-ca83bec21a31 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:06.298888 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-54bd2f35-1888-4e0c-b6fc-ca83bec21a31 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:06.549125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-54bd2f35-1888-4e0c-b6fc-ca83bec21a31 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:06.558318 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-54bd2f35-1888-4e0c-b6fc-ca83bec21a31 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:06.559852 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-54bd2f35-1888-4e0c-b6fc-ca83bec21a31 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:06.561043 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-54bd2f35-1888-4e0c-b6fc-ca83bec21a31 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1736 microversion: 2.20 time: 0.291739 Jul 19 20:53:06.562646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 204/440] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:06 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1736 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:07.583752 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ed3050cc-4334-408e-bc5a-2886f8b75614 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:07.584743 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ed3050cc-4334-408e-bc5a-2886f8b75614 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:07.596174 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed3050cc-4334-408e-bc5a-2886f8b75614 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:07.596914 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed3050cc-4334-408e-bc5a-2886f8b75614 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:07.599230 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed3050cc-4334-408e-bc5a-2886f8b75614 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:07.600250 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed3050cc-4334-408e-bc5a-2886f8b75614 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:07.830487 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ed3050cc-4334-408e-bc5a-2886f8b75614 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:07.845201 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ed3050cc-4334-408e-bc5a-2886f8b75614 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:07.846997 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ed3050cc-4334-408e-bc5a-2886f8b75614 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:07.848986 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ed3050cc-4334-408e-bc5a-2886f8b75614 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1736 microversion: 2.20 time: 0.271906 Jul 19 20:53:07.850109 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 237/441] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:07 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1736 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:08.719477 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a4ec2776-9179-43d1-a8e3-e679554ff581 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:08.720488 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a4ec2776-9179-43d1-a8e3-e679554ff581 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:08.729633 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a4ec2776-9179-43d1-a8e3-e679554ff581 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:08.730094 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a4ec2776-9179-43d1-a8e3-e679554ff581 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:08.731166 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a4ec2776-9179-43d1-a8e3-e679554ff581 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:08.731609 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a4ec2776-9179-43d1-a8e3-e679554ff581 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:08.766651 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a4ec2776-9179-43d1-a8e3-e679554ff581 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/ips" status: 200 len: 145 microversion: 2.1 time: 0.052970 Jul 19 20:53:08.773336 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 205/442] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jul 19 20:53:08 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/ips => generated 145 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:53:08.882844 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-137e09ca-ad1e-41a5-9c34-5d55540b8ab4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:08.884051 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-137e09ca-ad1e-41a5-9c34-5d55540b8ab4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:08.894212 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-137e09ca-ad1e-41a5-9c34-5d55540b8ab4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:08.894912 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-137e09ca-ad1e-41a5-9c34-5d55540b8ab4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:08.896202 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-137e09ca-ad1e-41a5-9c34-5d55540b8ab4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:08.897111 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-137e09ca-ad1e-41a5-9c34-5d55540b8ab4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:09.166108 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-137e09ca-ad1e-41a5-9c34-5d55540b8ab4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:09.179966 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-137e09ca-ad1e-41a5-9c34-5d55540b8ab4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:09.183375 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-137e09ca-ad1e-41a5-9c34-5d55540b8ab4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:09.185507 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-137e09ca-ad1e-41a5-9c34-5d55540b8ab4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1736 microversion: 2.20 time: 0.309486 Jul 19 20:53:09.187369 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 238/443] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:08 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1736 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:10.219338 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-35c272e1-9251-4a12-82c8-dd15f45afb15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:10.220215 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-35c272e1-9251-4a12-82c8-dd15f45afb15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:10.232115 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-35c272e1-9251-4a12-82c8-dd15f45afb15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:10.236803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-35c272e1-9251-4a12-82c8-dd15f45afb15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:10.238123 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-35c272e1-9251-4a12-82c8-dd15f45afb15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:10.239409 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-35c272e1-9251-4a12-82c8-dd15f45afb15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:10.564116 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-35c272e1-9251-4a12-82c8-dd15f45afb15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:10.587367 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-35c272e1-9251-4a12-82c8-dd15f45afb15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:10.591267 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-35c272e1-9251-4a12-82c8-dd15f45afb15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:10.594755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-35c272e1-9251-4a12-82c8-dd15f45afb15 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1736 microversion: 2.20 time: 0.379318 Jul 19 20:53:10.597487 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 206/444] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:10 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1736 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:11.626024 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-68e0b3e6-4d50-4a30-b9b2-a61938bb29d0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:11.627099 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-68e0b3e6-4d50-4a30-b9b2-a61938bb29d0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:11.634727 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-68e0b3e6-4d50-4a30-b9b2-a61938bb29d0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:11.635387 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-68e0b3e6-4d50-4a30-b9b2-a61938bb29d0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:11.636638 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-68e0b3e6-4d50-4a30-b9b2-a61938bb29d0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:11.637297 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-68e0b3e6-4d50-4a30-b9b2-a61938bb29d0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:11.883986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7d24c152-8a42-49eb-a88b-a93d30271e01 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa68e593-ced8-4ba8-9c84-92a240f8e848"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:11.887373 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7d24c152-8a42-49eb-a88b-a93d30271e01 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:11.896054 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7d24c152-8a42-49eb-a88b-a93d30271e01 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:11.896873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7d24c152-8a42-49eb-a88b-a93d30271e01 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:11.897943 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7d24c152-8a42-49eb-a88b-a93d30271e01 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:11.898453 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7d24c152-8a42-49eb-a88b-a93d30271e01 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:11.899802 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-68e0b3e6-4d50-4a30-b9b2-a61938bb29d0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:11.913422 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-68e0b3e6-4d50-4a30-b9b2-a61938bb29d0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:11.917099 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-68e0b3e6-4d50-4a30-b9b2-a61938bb29d0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:11.919594 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-68e0b3e6-4d50-4a30-b9b2-a61938bb29d0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1736 microversion: 2.20 time: 0.299827 Jul 19 20:53:11.921524 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 239/445] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:11 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1736 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:12.315459 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7d24c152-8a42-49eb-a88b-a93d30271e01 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "POST /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439035 Jul 19 20:53:12.316985 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 207/446] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 20:53:11 2022] POST /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:53:12.941650 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0ebf9c43-ff10-4cb4-b369-2f2aadbbe264 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:12.942513 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0ebf9c43-ff10-4cb4-b369-2f2aadbbe264 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:12.949120 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0ebf9c43-ff10-4cb4-b369-2f2aadbbe264 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:12.949603 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0ebf9c43-ff10-4cb4-b369-2f2aadbbe264 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:12.950381 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0ebf9c43-ff10-4cb4-b369-2f2aadbbe264 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:12.950877 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0ebf9c43-ff10-4cb4-b369-2f2aadbbe264 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:13.130392 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0ebf9c43-ff10-4cb4-b369-2f2aadbbe264 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:13.138836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0ebf9c43-ff10-4cb4-b369-2f2aadbbe264 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:13.140992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0ebf9c43-ff10-4cb4-b369-2f2aadbbe264 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:13.142209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0ebf9c43-ff10-4cb4-b369-2f2aadbbe264 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1736 microversion: 2.20 time: 0.206631 Jul 19 20:53:13.142766 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 240/447] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:12 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:14.166068 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-6790b7d9-a637-4761-99f1-3481c6632c7d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:14.167348 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-6790b7d9-a637-4761-99f1-3481c6632c7d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:14.178214 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6790b7d9-a637-4761-99f1-3481c6632c7d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:14.178672 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6790b7d9-a637-4761-99f1-3481c6632c7d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:14.179464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6790b7d9-a637-4761-99f1-3481c6632c7d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:14.179913 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6790b7d9-a637-4761-99f1-3481c6632c7d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:14.357052 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6790b7d9-a637-4761-99f1-3481c6632c7d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:14.366439 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6790b7d9-a637-4761-99f1-3481c6632c7d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:14.367962 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6790b7d9-a637-4761-99f1-3481c6632c7d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:14.369221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-6790b7d9-a637-4761-99f1-3481c6632c7d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1718 microversion: 2.20 time: 0.212030 Jul 19 20:53:14.369802 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 208/448] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:14 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1718 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:15.389269 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-63cab09e-3be9-495b-ac6d-2ad588c354d4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:15.390054 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-63cab09e-3be9-495b-ac6d-2ad588c354d4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:15.396858 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-63cab09e-3be9-495b-ac6d-2ad588c354d4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:15.397301 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-63cab09e-3be9-495b-ac6d-2ad588c354d4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:15.398098 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-63cab09e-3be9-495b-ac6d-2ad588c354d4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:15.398528 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-63cab09e-3be9-495b-ac6d-2ad588c354d4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:15.560684 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-63cab09e-3be9-495b-ac6d-2ad588c354d4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:15.574045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-63cab09e-3be9-495b-ac6d-2ad588c354d4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:15.575738 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-63cab09e-3be9-495b-ac6d-2ad588c354d4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:15.577288 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-63cab09e-3be9-495b-ac6d-2ad588c354d4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1718 microversion: 2.20 time: 0.192021 Jul 19 20:53:15.578413 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 241/449] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:15 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1718 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:16.600228 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fd056304-9d1b-45c1-82b6-915c66267763 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:16.600977 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-fd056304-9d1b-45c1-82b6-915c66267763 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:16.607881 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fd056304-9d1b-45c1-82b6-915c66267763 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:16.608360 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fd056304-9d1b-45c1-82b6-915c66267763 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:16.609157 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fd056304-9d1b-45c1-82b6-915c66267763 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:16.609626 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fd056304-9d1b-45c1-82b6-915c66267763 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:16.777201 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-fd056304-9d1b-45c1-82b6-915c66267763 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:16.786197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-fd056304-9d1b-45c1-82b6-915c66267763 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:16.787739 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-fd056304-9d1b-45c1-82b6-915c66267763 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:16.788946 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fd056304-9d1b-45c1-82b6-915c66267763 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1661 microversion: 2.20 time: 0.193115 Jul 19 20:53:16.789559 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 209/450] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:16 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1661 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:53:16.807888 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a9b8cf99-69de-441e-aafe-9fd09b4d5966 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ab339aa-5489-471a-afce-9e8f8e7477a1"}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:16.809862 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a9b8cf99-69de-441e-aafe-9fd09b4d5966 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:16.817489 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a9b8cf99-69de-441e-aafe-9fd09b4d5966 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:16.817943 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a9b8cf99-69de-441e-aafe-9fd09b4d5966 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:16.819035 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a9b8cf99-69de-441e-aafe-9fd09b4d5966 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:16.819473 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a9b8cf99-69de-441e-aafe-9fd09b4d5966 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:17.175148 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a9b8cf99-69de-441e-aafe-9fd09b4d5966 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "POST /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.371297 Jul 19 20:53:17.175962 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 242/451] 10.222.0.70 () {62 vars in 1363 bytes} [Tue Jul 19 20:53:16 2022] POST /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-volume_attachments => generated 188 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:53:17.314845 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8ec9d1f8-42d1-444f-9147-6c4af570aa50 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:17.315417 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8ec9d1f8-42d1-444f-9147-6c4af570aa50 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:17.322565 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8ec9d1f8-42d1-444f-9147-6c4af570aa50 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:17.323018 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8ec9d1f8-42d1-444f-9147-6c4af570aa50 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:17.323811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8ec9d1f8-42d1-444f-9147-6c4af570aa50 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:17.324248 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8ec9d1f8-42d1-444f-9147-6c4af570aa50 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:17.451212 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8ec9d1f8-42d1-444f-9147-6c4af570aa50 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "POST /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/action" status: 202 len: 0 microversion: 2.20 time: 0.140820 Jul 19 20:53:17.455051 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 210/452] 10.222.0.70 () {62 vars in 1318 bytes} [Tue Jul 19 20:53:17 2022] POST /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:53:17.460461 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f27fd90e-1155-4daa-89c3-0ee9b8f2fd04 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:17.461074 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f27fd90e-1155-4daa-89c3-0ee9b8f2fd04 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:17.468478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f27fd90e-1155-4daa-89c3-0ee9b8f2fd04 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:17.468928 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f27fd90e-1155-4daa-89c3-0ee9b8f2fd04 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:17.469766 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f27fd90e-1155-4daa-89c3-0ee9b8f2fd04 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:17.470201 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f27fd90e-1155-4daa-89c3-0ee9b8f2fd04 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:17.648339 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f27fd90e-1155-4daa-89c3-0ee9b8f2fd04 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:17.664209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f27fd90e-1155-4daa-89c3-0ee9b8f2fd04 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:17.667264 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f27fd90e-1155-4daa-89c3-0ee9b8f2fd04 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:17.669586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f27fd90e-1155-4daa-89c3-0ee9b8f2fd04 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1747 microversion: 2.20 time: 0.213021 Jul 19 20:53:17.670535 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 243/453] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:17 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1747 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:53:17.725217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-de3fa7fc-ffe6-48d7-86ca-3efb1bb1c247 req-66a72311-97c7-43b6-a725-c0e149996f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e43f46e-319f-4ec4-8d5a-0e95995dc370", "name": "network-vif-unplugged", "status": "completed", "tag": "8f0876b6-27aa-4999-81eb-a3e576f37753"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:17.738243 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-de3fa7fc-ffe6-48d7-86ca-3efb1bb1c247 req-66a72311-97c7-43b6-a725-c0e149996f7c service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:17.739051 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-de3fa7fc-ffe6-48d7-86ca-3efb1bb1c247 req-66a72311-97c7-43b6-a725-c0e149996f7c service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:17.755501 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.compute.server_external_events [req-de3fa7fc-ffe6-48d7-86ca-3efb1bb1c247 req-66a72311-97c7-43b6-a725-c0e149996f7c service nova] Unable to find a host for instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370. Dropping event network-vif-unplugged {{(pid=129867) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 20:53:17.757044 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-de3fa7fc-ffe6-48d7-86ca-3efb1bb1c247 req-66a72311-97c7-43b6-a725-c0e149996f7c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036236 Jul 19 20:53:17.758262 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 211/454] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 19 20:53:18.691103 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-03925c2e-ad23-4f10-9ea7-a6a9dd09b677 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:18.692102 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-03925c2e-ad23-4f10-9ea7-a6a9dd09b677 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:18.700469 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-03925c2e-ad23-4f10-9ea7-a6a9dd09b677 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:18.700970 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-03925c2e-ad23-4f10-9ea7-a6a9dd09b677 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:18.702460 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-03925c2e-ad23-4f10-9ea7-a6a9dd09b677 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:18.703083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-03925c2e-ad23-4f10-9ea7-a6a9dd09b677 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:18.880306 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-03925c2e-ad23-4f10-9ea7-a6a9dd09b677 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:18.892130 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-03925c2e-ad23-4f10-9ea7-a6a9dd09b677 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:18.893812 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-03925c2e-ad23-4f10-9ea7-a6a9dd09b677 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:18.895126 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-03925c2e-ad23-4f10-9ea7-a6a9dd09b677 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1747 microversion: 2.20 time: 0.208762 Jul 19 20:53:18.895699 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 244/455] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:18 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1747 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:19.919211 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9faa7296-d8bb-4d4c-b2cf-5fa64bad9239 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:19.922076 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9faa7296-d8bb-4d4c-b2cf-5fa64bad9239 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:19.952168 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9faa7296-d8bb-4d4c-b2cf-5fa64bad9239 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:19.952980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9faa7296-d8bb-4d4c-b2cf-5fa64bad9239 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:19.954621 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9faa7296-d8bb-4d4c-b2cf-5fa64bad9239 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:19.955404 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9faa7296-d8bb-4d4c-b2cf-5fa64bad9239 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:20.055504 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8fa545bf-4e85-4457-b041-7559776cbcf5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:20.068354 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8fa545bf-4e85-4457-b041-7559776cbcf5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:20.069564 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8fa545bf-4e85-4457-b041-7559776cbcf5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:20.144273 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8fa545bf-4e85-4457-b041-7559776cbcf5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Going to try to stop instance {{(pid=129866) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:53:20.174358 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9faa7296-d8bb-4d4c-b2cf-5fa64bad9239 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:20.178837 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:20.179177 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:20.192304 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9faa7296-d8bb-4d4c-b2cf-5fa64bad9239 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:20.195343 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9faa7296-d8bb-4d4c-b2cf-5fa64bad9239 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:20.197394 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9faa7296-d8bb-4d4c-b2cf-5fa64bad9239 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1749 microversion: 2.20 time: 0.285935 Jul 19 20:53:20.198331 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 212/456] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:19 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1749 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:20.213966 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8fa545bf-4e85-4457-b041-7559776cbcf5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "POST /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/action" status: 202 len: 0 microversion: 2.1 time: 0.166022 Jul 19 20:53:20.214846 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 245/457] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 20:53:20 2022] POST /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:53:20.224920 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f9315d23-4ce8-4ff0-9972-9a8b3a17a6a4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:20.225585 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f9315d23-4ce8-4ff0-9972-9a8b3a17a6a4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:20.233584 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f9315d23-4ce8-4ff0-9972-9a8b3a17a6a4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:20.234040 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f9315d23-4ce8-4ff0-9972-9a8b3a17a6a4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:20.234844 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f9315d23-4ce8-4ff0-9972-9a8b3a17a6a4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:20.235291 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f9315d23-4ce8-4ff0-9972-9a8b3a17a6a4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:20.400819 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f9315d23-4ce8-4ff0-9972-9a8b3a17a6a4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:20.416405 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f9315d23-4ce8-4ff0-9972-9a8b3a17a6a4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.195673 Jul 19 20:53:20.426780 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 213/458] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:20 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:20.967240 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-051bc6ae-464b-4e8c-b8f1-1c4ca19435d8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d3d5f13-1b6a-4935-afc9-07fc1577f933"}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:20.968549 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-051bc6ae-464b-4e8c-b8f1-1c4ca19435d8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:20.977650 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-051bc6ae-464b-4e8c-b8f1-1c4ca19435d8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:20.978102 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-051bc6ae-464b-4e8c-b8f1-1c4ca19435d8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:20.978903 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-051bc6ae-464b-4e8c-b8f1-1c4ca19435d8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:20.979343 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-051bc6ae-464b-4e8c-b8f1-1c4ca19435d8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:21.222718 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d06f0372-0a37-4b15-8678-9b3087afc95d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:21.224140 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d06f0372-0a37-4b15-8678-9b3087afc95d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:21.237677 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d06f0372-0a37-4b15-8678-9b3087afc95d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:21.238366 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d06f0372-0a37-4b15-8678-9b3087afc95d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:21.239447 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d06f0372-0a37-4b15-8678-9b3087afc95d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:21.240177 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d06f0372-0a37-4b15-8678-9b3087afc95d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:21.362926 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-051bc6ae-464b-4e8c-b8f1-1c4ca19435d8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "POST /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401313 Jul 19 20:53:21.379780 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 246/459] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 20:53:20 2022] POST /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:53:21.439657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a74387ca-334f-4c77-b361-c9aaf8f32469 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:21.440868 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a74387ca-334f-4c77-b361-c9aaf8f32469 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:21.453675 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a74387ca-334f-4c77-b361-c9aaf8f32469 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:21.454541 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a74387ca-334f-4c77-b361-c9aaf8f32469 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:21.456271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a74387ca-334f-4c77-b361-c9aaf8f32469 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:21.457100 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a74387ca-334f-4c77-b361-c9aaf8f32469 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:21.465387 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d06f0372-0a37-4b15-8678-9b3087afc95d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:21.482985 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d06f0372-0a37-4b15-8678-9b3087afc95d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:21.486208 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d06f0372-0a37-4b15-8678-9b3087afc95d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:21.488431 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d06f0372-0a37-4b15-8678-9b3087afc95d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.270262 Jul 19 20:53:21.493447 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 214/460] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:21 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:53:21.692268 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-a74387ca-334f-4c77-b361-c9aaf8f32469 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:21.710340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a74387ca-334f-4c77-b361-c9aaf8f32469 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.276967 Jul 19 20:53:21.711988 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 247/461] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:21 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:22.517070 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-85b1f838-e477-4919-948e-2c1124ed76bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:22.517805 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-85b1f838-e477-4919-948e-2c1124ed76bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:22.525069 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-85b1f838-e477-4919-948e-2c1124ed76bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:22.525694 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-85b1f838-e477-4919-948e-2c1124ed76bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:22.526725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-85b1f838-e477-4919-948e-2c1124ed76bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:22.527172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-85b1f838-e477-4919-948e-2c1124ed76bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:22.730880 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-44f41586-2cbe-4b63-9e2f-853b93bd77b5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:22.732753 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-44f41586-2cbe-4b63-9e2f-853b93bd77b5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:22.742760 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-44f41586-2cbe-4b63-9e2f-853b93bd77b5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:22.743253 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-85b1f838-e477-4919-948e-2c1124ed76bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:22.746203 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-44f41586-2cbe-4b63-9e2f-853b93bd77b5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:22.746203 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-44f41586-2cbe-4b63-9e2f-853b93bd77b5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:22.746203 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-44f41586-2cbe-4b63-9e2f-853b93bd77b5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:22.754995 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-85b1f838-e477-4919-948e-2c1124ed76bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:22.756827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-85b1f838-e477-4919-948e-2c1124ed76bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:22.758096 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-85b1f838-e477-4919-948e-2c1124ed76bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.245114 Jul 19 20:53:22.758707 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 215/462] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:22 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:22.927587 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-44f41586-2cbe-4b63-9e2f-853b93bd77b5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:22.941800 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-44f41586-2cbe-4b63-9e2f-853b93bd77b5 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.214477 Jul 19 20:53:22.942781 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 248/463] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:22 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:23.781496 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d8e4e90a-2e88-4536-af3e-d065b9ab8bbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:23.783900 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d8e4e90a-2e88-4536-af3e-d065b9ab8bbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:23.792102 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d8e4e90a-2e88-4536-af3e-d065b9ab8bbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:23.792551 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d8e4e90a-2e88-4536-af3e-d065b9ab8bbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:23.793419 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d8e4e90a-2e88-4536-af3e-d065b9ab8bbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:23.793825 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d8e4e90a-2e88-4536-af3e-d065b9ab8bbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:23.947717 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d8e4e90a-2e88-4536-af3e-d065b9ab8bbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:23.959011 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d8e4e90a-2e88-4536-af3e-d065b9ab8bbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:23.960757 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d8e4e90a-2e88-4536-af3e-d065b9ab8bbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:23.961806 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-64c94789-089c-4451-a42c-2fd00a01bfec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:23.962302 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d8e4e90a-2e88-4536-af3e-d065b9ab8bbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.188546 Jul 19 20:53:23.963106 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-64c94789-089c-4451-a42c-2fd00a01bfec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:23.963235 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 216/464] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:23 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:23.971204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-64c94789-089c-4451-a42c-2fd00a01bfec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:23.971955 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-64c94789-089c-4451-a42c-2fd00a01bfec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:23.972909 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-64c94789-089c-4451-a42c-2fd00a01bfec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:23.973806 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-64c94789-089c-4451-a42c-2fd00a01bfec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:24.133595 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-64c94789-089c-4451-a42c-2fd00a01bfec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:24.144342 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-64c94789-089c-4451-a42c-2fd00a01bfec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.186545 Jul 19 20:53:24.144979 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 249/465] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:23 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:24.991054 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c7023458-ee00-446d-bc97-e25b0fc4260a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:24.992739 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c7023458-ee00-446d-bc97-e25b0fc4260a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:25.000512 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c7023458-ee00-446d-bc97-e25b0fc4260a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:25.000964 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c7023458-ee00-446d-bc97-e25b0fc4260a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:25.001805 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c7023458-ee00-446d-bc97-e25b0fc4260a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:25.002245 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c7023458-ee00-446d-bc97-e25b0fc4260a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:25.175021 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6d160a7e-2615-4aec-8ec4-5c8c31693c6c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:25.177497 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6d160a7e-2615-4aec-8ec4-5c8c31693c6c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:25.188791 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6d160a7e-2615-4aec-8ec4-5c8c31693c6c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:25.190124 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6d160a7e-2615-4aec-8ec4-5c8c31693c6c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:25.191880 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6d160a7e-2615-4aec-8ec4-5c8c31693c6c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:25.192966 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6d160a7e-2615-4aec-8ec4-5c8c31693c6c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:25.208279 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c7023458-ee00-446d-bc97-e25b0fc4260a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:25.222426 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c7023458-ee00-446d-bc97-e25b0fc4260a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:25.224831 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c7023458-ee00-446d-bc97-e25b0fc4260a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:25.226346 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c7023458-ee00-446d-bc97-e25b0fc4260a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.243468 Jul 19 20:53:25.227054 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 217/466] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:24 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:25.409506 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6d160a7e-2615-4aec-8ec4-5c8c31693c6c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:25.426284 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6d160a7e-2615-4aec-8ec4-5c8c31693c6c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.258872 Jul 19 20:53:25.436937 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 250/467] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:25 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:26.246708 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d7b60958-a5e5-4e6d-a5e4-1800fb28ebe7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:26.248090 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d7b60958-a5e5-4e6d-a5e4-1800fb28ebe7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:26.256001 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d7b60958-a5e5-4e6d-a5e4-1800fb28ebe7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:26.256458 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d7b60958-a5e5-4e6d-a5e4-1800fb28ebe7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:26.257253 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d7b60958-a5e5-4e6d-a5e4-1800fb28ebe7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:26.257850 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d7b60958-a5e5-4e6d-a5e4-1800fb28ebe7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:26.459342 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f738c4e7-f5aa-4be5-bccd-6fb86a1a2e46 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:26.460295 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f738c4e7-f5aa-4be5-bccd-6fb86a1a2e46 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:26.476208 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f738c4e7-f5aa-4be5-bccd-6fb86a1a2e46 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:26.476955 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f738c4e7-f5aa-4be5-bccd-6fb86a1a2e46 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:26.477775 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d7b60958-a5e5-4e6d-a5e4-1800fb28ebe7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:26.478325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f738c4e7-f5aa-4be5-bccd-6fb86a1a2e46 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:26.479149 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f738c4e7-f5aa-4be5-bccd-6fb86a1a2e46 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:26.498944 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d7b60958-a5e5-4e6d-a5e4-1800fb28ebe7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:26.500523 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d7b60958-a5e5-4e6d-a5e4-1800fb28ebe7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:26.502631 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d7b60958-a5e5-4e6d-a5e4-1800fb28ebe7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.260629 Jul 19 20:53:26.503474 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 218/468] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:26 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:26.675597 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f738c4e7-f5aa-4be5-bccd-6fb86a1a2e46 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:26.695891 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f738c4e7-f5aa-4be5-bccd-6fb86a1a2e46 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.253742 Jul 19 20:53:26.697053 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 251/469] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:26 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:27.523179 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5429267a-6fe9-46b7-b997-ef55112d63aa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:27.524015 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5429267a-6fe9-46b7-b997-ef55112d63aa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:27.532191 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5429267a-6fe9-46b7-b997-ef55112d63aa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:27.532647 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5429267a-6fe9-46b7-b997-ef55112d63aa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:27.533487 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5429267a-6fe9-46b7-b997-ef55112d63aa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:27.533929 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5429267a-6fe9-46b7-b997-ef55112d63aa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:27.726699 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c5d9d569-9192-4e9e-96e7-00b3cbbb1de0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:27.727840 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c5d9d569-9192-4e9e-96e7-00b3cbbb1de0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:27.736013 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5429267a-6fe9-46b7-b997-ef55112d63aa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:27.739529 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c5d9d569-9192-4e9e-96e7-00b3cbbb1de0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:27.740323 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c5d9d569-9192-4e9e-96e7-00b3cbbb1de0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:27.741853 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c5d9d569-9192-4e9e-96e7-00b3cbbb1de0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:27.742606 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c5d9d569-9192-4e9e-96e7-00b3cbbb1de0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:27.751658 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5429267a-6fe9-46b7-b997-ef55112d63aa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:27.754787 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5429267a-6fe9-46b7-b997-ef55112d63aa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:27.757135 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5429267a-6fe9-46b7-b997-ef55112d63aa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.237919 Jul 19 20:53:27.758206 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 219/470] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:27 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:53:27.910698 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c5d9d569-9192-4e9e-96e7-00b3cbbb1de0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:27.922722 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c5d9d569-9192-4e9e-96e7-00b3cbbb1de0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.203131 Jul 19 20:53:27.924289 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 252/471] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:27 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:28.786486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a4e2653b-8aa8-4daf-aa32-b747878708a0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:28.787512 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a4e2653b-8aa8-4daf-aa32-b747878708a0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:28.795352 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a4e2653b-8aa8-4daf-aa32-b747878708a0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:28.796410 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a4e2653b-8aa8-4daf-aa32-b747878708a0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:28.797302 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a4e2653b-8aa8-4daf-aa32-b747878708a0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:28.797863 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a4e2653b-8aa8-4daf-aa32-b747878708a0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:28.949146 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-aa259182-5218-4e7a-8b1d-4abaa909a23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:28.951486 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-aa259182-5218-4e7a-8b1d-4abaa909a23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:28.953520 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a4e2653b-8aa8-4daf-aa32-b747878708a0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:28.964921 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aa259182-5218-4e7a-8b1d-4abaa909a23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:28.966282 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aa259182-5218-4e7a-8b1d-4abaa909a23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:28.969762 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aa259182-5218-4e7a-8b1d-4abaa909a23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:28.972460 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aa259182-5218-4e7a-8b1d-4abaa909a23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:28.985858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a4e2653b-8aa8-4daf-aa32-b747878708a0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:28.987877 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a4e2653b-8aa8-4daf-aa32-b747878708a0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:28.989479 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a4e2653b-8aa8-4daf-aa32-b747878708a0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.207619 Jul 19 20:53:28.990622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 220/472] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:28 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:29.194415 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-aa259182-5218-4e7a-8b1d-4abaa909a23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:29.206895 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-aa259182-5218-4e7a-8b1d-4abaa909a23e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.263449 Jul 19 20:53:29.208316 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 253/473] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:28 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:30.029044 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-1d43de14-b235-458a-a816-f5de079b9e68 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:30.030803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-1d43de14-b235-458a-a816-f5de079b9e68 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:30.043530 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1d43de14-b235-458a-a816-f5de079b9e68 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:30.044359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1d43de14-b235-458a-a816-f5de079b9e68 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:30.045944 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1d43de14-b235-458a-a816-f5de079b9e68 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:30.046868 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1d43de14-b235-458a-a816-f5de079b9e68 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:30.251360 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0f06e160-3456-405d-b6c3-9a987bf1a370 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:30.254119 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0f06e160-3456-405d-b6c3-9a987bf1a370 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:30.268495 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=40 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:30.272257 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0f06e160-3456-405d-b6c3-9a987bf1a370 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:30.273856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0f06e160-3456-405d-b6c3-9a987bf1a370 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:30.275649 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0f06e160-3456-405d-b6c3-9a987bf1a370 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:30.277168 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0f06e160-3456-405d-b6c3-9a987bf1a370 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:30.302300 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1d43de14-b235-458a-a816-f5de079b9e68 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:30.320616 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1d43de14-b235-458a-a816-f5de079b9e68 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:30.324345 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1d43de14-b235-458a-a816-f5de079b9e68 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:30.328129 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-1d43de14-b235-458a-a816-f5de079b9e68 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.311649 Jul 19 20:53:30.337409 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 221/474] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:30 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:53:30.491709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0f06e160-3456-405d-b6c3-9a987bf1a370 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:30.508159 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0f06e160-3456-405d-b6c3-9a987bf1a370 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.268628 Jul 19 20:53:30.509310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 254/475] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:30 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:31.361341 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9f41fb37-efef-4074-9d2d-096b019db96f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:31.362822 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9f41fb37-efef-4074-9d2d-096b019db96f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:31.367006 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=42 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:31.371435 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f41fb37-efef-4074-9d2d-096b019db96f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:31.372259 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f41fb37-efef-4074-9d2d-096b019db96f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:31.373990 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f41fb37-efef-4074-9d2d-096b019db96f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:31.374912 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f41fb37-efef-4074-9d2d-096b019db96f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:31.536508 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-44b59c0c-3cc8-488a-bb1c-11b0ee37e73b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:31.537468 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-44b59c0c-3cc8-488a-bb1c-11b0ee37e73b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:31.546936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-44b59c0c-3cc8-488a-bb1c-11b0ee37e73b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:31.547468 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-44b59c0c-3cc8-488a-bb1c-11b0ee37e73b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:31.548360 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-44b59c0c-3cc8-488a-bb1c-11b0ee37e73b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:31.548879 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-44b59c0c-3cc8-488a-bb1c-11b0ee37e73b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:31.568083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9f41fb37-efef-4074-9d2d-096b019db96f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:31.578120 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9f41fb37-efef-4074-9d2d-096b019db96f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:31.580251 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9f41fb37-efef-4074-9d2d-096b019db96f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:31.582341 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9f41fb37-efef-4074-9d2d-096b019db96f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.225452 Jul 19 20:53:31.583031 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 222/476] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:31 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:53:31.755763 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-44b59c0c-3cc8-488a-bb1c-11b0ee37e73b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:31.771612 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-44b59c0c-3cc8-488a-bb1c-11b0ee37e73b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.238802 Jul 19 20:53:31.772495 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 255/477] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:31 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:32.610664 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f5ce1d2b-b5a9-440e-889d-bc01d8f701bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:32.611337 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f5ce1d2b-b5a9-440e-889d-bc01d8f701bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:32.618791 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f5ce1d2b-b5a9-440e-889d-bc01d8f701bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:32.619247 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f5ce1d2b-b5a9-440e-889d-bc01d8f701bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:32.620048 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f5ce1d2b-b5a9-440e-889d-bc01d8f701bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:32.620492 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f5ce1d2b-b5a9-440e-889d-bc01d8f701bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:32.793882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f5ce1d2b-b5a9-440e-889d-bc01d8f701bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:32.799438 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6c74c831-0b09-4ee0-b59e-6daa8a6f2086 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:32.800420 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6c74c831-0b09-4ee0-b59e-6daa8a6f2086 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:32.807067 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f5ce1d2b-b5a9-440e-889d-bc01d8f701bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:32.807801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6c74c831-0b09-4ee0-b59e-6daa8a6f2086 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:32.808253 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6c74c831-0b09-4ee0-b59e-6daa8a6f2086 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:32.809030 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6c74c831-0b09-4ee0-b59e-6daa8a6f2086 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:32.809569 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6c74c831-0b09-4ee0-b59e-6daa8a6f2086 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:32.810323 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f5ce1d2b-b5a9-440e-889d-bc01d8f701bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:32.812462 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f5ce1d2b-b5a9-440e-889d-bc01d8f701bb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.206578 Jul 19 20:53:32.813502 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 223/478] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:32 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:32.963657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6c74c831-0b09-4ee0-b59e-6daa8a6f2086 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:32.974062 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6c74c831-0b09-4ee0-b59e-6daa8a6f2086 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.179528 Jul 19 20:53:32.974662 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 256/479] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:32 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:33.832727 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-938e004d-da36-47c5-beb8-bb70e115d56a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:33.834353 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-938e004d-da36-47c5-beb8-bb70e115d56a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:33.840985 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-938e004d-da36-47c5-beb8-bb70e115d56a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:33.841470 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-938e004d-da36-47c5-beb8-bb70e115d56a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:33.842732 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-938e004d-da36-47c5-beb8-bb70e115d56a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:33.843160 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-938e004d-da36-47c5-beb8-bb70e115d56a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:33.985154 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-938e004d-da36-47c5-beb8-bb70e115d56a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:33.993497 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d69ed8b8-cfcd-4a24-9f1b-d93f908e9fac tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:33.994090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d69ed8b8-cfcd-4a24-9f1b-d93f908e9fac tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:33.994575 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-938e004d-da36-47c5-beb8-bb70e115d56a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:33.996124 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-938e004d-da36-47c5-beb8-bb70e115d56a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:33.997330 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-938e004d-da36-47c5-beb8-bb70e115d56a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.169035 Jul 19 20:53:33.998324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 224/480] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:33 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:34.003735 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d69ed8b8-cfcd-4a24-9f1b-d93f908e9fac tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:34.004876 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d69ed8b8-cfcd-4a24-9f1b-d93f908e9fac tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:34.006894 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d69ed8b8-cfcd-4a24-9f1b-d93f908e9fac tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:34.008220 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d69ed8b8-cfcd-4a24-9f1b-d93f908e9fac tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:34.174683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d69ed8b8-cfcd-4a24-9f1b-d93f908e9fac tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:34.183257 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d69ed8b8-cfcd-4a24-9f1b-d93f908e9fac tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.193731 Jul 19 20:53:34.184614 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 257/481] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:33 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:35.018731 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-92d293e9-0cf8-4d7f-8773-09dc6fc39679 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:35.019945 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-92d293e9-0cf8-4d7f-8773-09dc6fc39679 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:35.028101 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-92d293e9-0cf8-4d7f-8773-09dc6fc39679 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:35.028586 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-92d293e9-0cf8-4d7f-8773-09dc6fc39679 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:35.029441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-92d293e9-0cf8-4d7f-8773-09dc6fc39679 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:35.029950 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-92d293e9-0cf8-4d7f-8773-09dc6fc39679 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:35.189711 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-92d293e9-0cf8-4d7f-8773-09dc6fc39679 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:35.198686 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-92d293e9-0cf8-4d7f-8773-09dc6fc39679 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:35.200304 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-92d293e9-0cf8-4d7f-8773-09dc6fc39679 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:35.201549 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-92d293e9-0cf8-4d7f-8773-09dc6fc39679 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.188893 Jul 19 20:53:35.202126 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 225/482] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:35 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:35.202734 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9d2b7d2f-90da-4ecd-a14d-6e83eabbef64 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:35.204025 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-9d2b7d2f-90da-4ecd-a14d-6e83eabbef64 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:35.216173 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9d2b7d2f-90da-4ecd-a14d-6e83eabbef64 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:35.216966 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9d2b7d2f-90da-4ecd-a14d-6e83eabbef64 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:35.218455 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9d2b7d2f-90da-4ecd-a14d-6e83eabbef64 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:35.219237 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9d2b7d2f-90da-4ecd-a14d-6e83eabbef64 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:35.372696 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9d2b7d2f-90da-4ecd-a14d-6e83eabbef64 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:35.381862 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9d2b7d2f-90da-4ecd-a14d-6e83eabbef64 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1720 microversion: 2.1 time: 0.184007 Jul 19 20:53:35.382465 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 258/483] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:35 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:36.229819 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2daed8d1-77f0-4958-b71c-4e98fa112952 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:36.230560 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2daed8d1-77f0-4958-b71c-4e98fa112952 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:36.238158 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2daed8d1-77f0-4958-b71c-4e98fa112952 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:36.238667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2daed8d1-77f0-4958-b71c-4e98fa112952 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:36.239524 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2daed8d1-77f0-4958-b71c-4e98fa112952 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:36.240010 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2daed8d1-77f0-4958-b71c-4e98fa112952 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:36.400609 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2814097a-353b-4669-8f4b-6d082b3547dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:36.401261 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2814097a-353b-4669-8f4b-6d082b3547dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:36.408651 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2814097a-353b-4669-8f4b-6d082b3547dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:36.409086 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2814097a-353b-4669-8f4b-6d082b3547dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:36.409913 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2814097a-353b-4669-8f4b-6d082b3547dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:36.410379 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2814097a-353b-4669-8f4b-6d082b3547dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:36.430739 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2daed8d1-77f0-4958-b71c-4e98fa112952 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:36.445994 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2daed8d1-77f0-4958-b71c-4e98fa112952 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:36.449673 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2daed8d1-77f0-4958-b71c-4e98fa112952 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:36.452671 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2daed8d1-77f0-4958-b71c-4e98fa112952 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.225890 Jul 19 20:53:36.453766 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 226/484] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:36 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:53:36.558004 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2814097a-353b-4669-8f4b-6d082b3547dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:36.567681 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2814097a-353b-4669-8f4b-6d082b3547dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1697 microversion: 2.1 time: 0.171221 Jul 19 20:53:36.568294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 259/485] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:36 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:36.585769 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ab75671f-0ae7-4c70-9a93-08f3e691268d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:36.592421 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ab75671f-0ae7-4c70-9a93-08f3e691268d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:36.592884 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ab75671f-0ae7-4c70-9a93-08f3e691268d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:36.657496 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ab75671f-0ae7-4c70-9a93-08f3e691268d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Going to try to start instance {{(pid=129867) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 20:53:36.714507 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ab75671f-0ae7-4c70-9a93-08f3e691268d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "POST /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/action" status: 202 len: 0 microversion: 2.1 time: 0.133087 Jul 19 20:53:36.715298 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 227/486] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 20:53:36 2022] POST /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:53:36.728036 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5561d827-7bab-45af-b2c2-19c1df89f142 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:36.728772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5561d827-7bab-45af-b2c2-19c1df89f142 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:36.737600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5561d827-7bab-45af-b2c2-19c1df89f142 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:36.738308 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5561d827-7bab-45af-b2c2-19c1df89f142 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:36.739261 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5561d827-7bab-45af-b2c2-19c1df89f142 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:36.739749 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5561d827-7bab-45af-b2c2-19c1df89f142 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:36.900916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5561d827-7bab-45af-b2c2-19c1df89f142 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:36.907093 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:36.914042 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5561d827-7bab-45af-b2c2-19c1df89f142 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1706 microversion: 2.1 time: 0.193996 Jul 19 20:53:36.914960 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 260/487] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:36 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1706 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:37.483732 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-64e28d72-21e2-477d-bdd8-3dd0faaf853d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:37.484613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-64e28d72-21e2-477d-bdd8-3dd0faaf853d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:37.491581 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-64e28d72-21e2-477d-bdd8-3dd0faaf853d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:37.492042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-64e28d72-21e2-477d-bdd8-3dd0faaf853d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:37.492893 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-64e28d72-21e2-477d-bdd8-3dd0faaf853d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:37.493401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-64e28d72-21e2-477d-bdd8-3dd0faaf853d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:37.515632 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:37.643726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-64e28d72-21e2-477d-bdd8-3dd0faaf853d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:37.652708 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-64e28d72-21e2-477d-bdd8-3dd0faaf853d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:37.654302 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-64e28d72-21e2-477d-bdd8-3dd0faaf853d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:37.656041 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-64e28d72-21e2-477d-bdd8-3dd0faaf853d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.178720 Jul 19 20:53:37.656610 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 228/488] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:37 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:37.935405 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e2479ce9-452d-4f62-8bb2-77e7274b0181 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:37.936229 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e2479ce9-452d-4f62-8bb2-77e7274b0181 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:37.943531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2479ce9-452d-4f62-8bb2-77e7274b0181 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:37.944015 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2479ce9-452d-4f62-8bb2-77e7274b0181 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:37.944795 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2479ce9-452d-4f62-8bb2-77e7274b0181 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:37.945228 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2479ce9-452d-4f62-8bb2-77e7274b0181 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:38.087036 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e2479ce9-452d-4f62-8bb2-77e7274b0181 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:38.096383 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e2479ce9-452d-4f62-8bb2-77e7274b0181 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1706 microversion: 2.1 time: 0.168121 Jul 19 20:53:38.096954 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 261/489] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:37 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1706 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:38.675872 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2591384c-c8d9-4398-8b69-8001ab97f6cb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:38.676495 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2591384c-c8d9-4398-8b69-8001ab97f6cb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:38.683871 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2591384c-c8d9-4398-8b69-8001ab97f6cb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:38.684328 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2591384c-c8d9-4398-8b69-8001ab97f6cb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:38.685135 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2591384c-c8d9-4398-8b69-8001ab97f6cb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:38.685639 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2591384c-c8d9-4398-8b69-8001ab97f6cb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:38.855635 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2591384c-c8d9-4398-8b69-8001ab97f6cb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:38.871180 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2591384c-c8d9-4398-8b69-8001ab97f6cb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:38.872832 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2591384c-c8d9-4398-8b69-8001ab97f6cb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:38.874281 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2591384c-c8d9-4398-8b69-8001ab97f6cb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.202357 Jul 19 20:53:38.875024 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 229/490] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:38 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:38.917156 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5a32ab65-cb81-49ee-8026-1ba60ad306e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:38.918549 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5a32ab65-cb81-49ee-8026-1ba60ad306e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:38.926191 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5a32ab65-cb81-49ee-8026-1ba60ad306e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:38.926650 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5a32ab65-cb81-49ee-8026-1ba60ad306e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:38.927442 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5a32ab65-cb81-49ee-8026-1ba60ad306e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:38.927885 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5a32ab65-cb81-49ee-8026-1ba60ad306e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:38.954464 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-5a32ab65-cb81-49ee-8026-1ba60ad306e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lazy-loading 'flavor' on Instance uuid 272b6112-4d76-4d2f-84ab-4382b998c781 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:53:39.083243 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5a32ab65-cb81-49ee-8026-1ba60ad306e9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "POST /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/action" status: 200 len: 32 microversion: 2.1 time: 0.170977 Jul 19 20:53:39.083762 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 262/491] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 20:53:38 2022] POST /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:53:39.092773 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b5ef5391-0adf-4817-ace7-fb90f00ad4fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:39.093420 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b5ef5391-0adf-4817-ace7-fb90f00ad4fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:39.099753 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5ef5391-0adf-4817-ace7-fb90f00ad4fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:39.100211 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5ef5391-0adf-4817-ace7-fb90f00ad4fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:39.100981 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5ef5391-0adf-4817-ace7-fb90f00ad4fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:39.101470 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5ef5391-0adf-4817-ace7-fb90f00ad4fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:39.117172 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-952b7bd3-6e23-42d7-9485-9c983ca40cee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:39.117913 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-952b7bd3-6e23-42d7-9485-9c983ca40cee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:39.125840 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-952b7bd3-6e23-42d7-9485-9c983ca40cee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:39.126587 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-952b7bd3-6e23-42d7-9485-9c983ca40cee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:39.127273 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-952b7bd3-6e23-42d7-9485-9c983ca40cee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:39.127719 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-952b7bd3-6e23-42d7-9485-9c983ca40cee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:39.306710 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b5ef5391-0adf-4817-ace7-fb90f00ad4fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:39.316072 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b5ef5391-0adf-4817-ace7-fb90f00ad4fc tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.226947 Jul 19 20:53:39.323057 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 230/492] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:39 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:39.332062 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-952b7bd3-6e23-42d7-9485-9c983ca40cee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:39.340372 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-952b7bd3-6e23-42d7-9485-9c983ca40cee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1706 microversion: 2.1 time: 0.229990 Jul 19 20:53:39.340881 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 263/493] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:39 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1706 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:39.895027 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-97094144-deb2-4e65-aef0-18ec0f9a0a95 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:39.895844 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-97094144-deb2-4e65-aef0-18ec0f9a0a95 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:39.903319 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-97094144-deb2-4e65-aef0-18ec0f9a0a95 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:39.903781 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-97094144-deb2-4e65-aef0-18ec0f9a0a95 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:39.905059 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-97094144-deb2-4e65-aef0-18ec0f9a0a95 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:39.905541 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-97094144-deb2-4e65-aef0-18ec0f9a0a95 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:40.102536 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-97094144-deb2-4e65-aef0-18ec0f9a0a95 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:40.121025 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-97094144-deb2-4e65-aef0-18ec0f9a0a95 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:40.124084 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-97094144-deb2-4e65-aef0-18ec0f9a0a95 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:40.126867 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-97094144-deb2-4e65-aef0-18ec0f9a0a95 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.237401 Jul 19 20:53:40.127934 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 231/494] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:39 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:53:40.335193 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ed465a5e-b5bd-4470-a77d-07b328e4697f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:40.335827 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ed465a5e-b5bd-4470-a77d-07b328e4697f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:40.342778 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed465a5e-b5bd-4470-a77d-07b328e4697f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:40.343220 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed465a5e-b5bd-4470-a77d-07b328e4697f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:40.343986 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed465a5e-b5bd-4470-a77d-07b328e4697f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:40.344419 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed465a5e-b5bd-4470-a77d-07b328e4697f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:40.363854 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-30dec8f8-00a1-4e02-abe3-8afea2f4c9ce tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:40.365140 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-30dec8f8-00a1-4e02-abe3-8afea2f4c9ce tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:40.375887 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-30dec8f8-00a1-4e02-abe3-8afea2f4c9ce tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:40.376213 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-30dec8f8-00a1-4e02-abe3-8afea2f4c9ce tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:40.377403 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-30dec8f8-00a1-4e02-abe3-8afea2f4c9ce tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:40.378088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-30dec8f8-00a1-4e02-abe3-8afea2f4c9ce tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:40.540373 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ed465a5e-b5bd-4470-a77d-07b328e4697f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:40.554531 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ed465a5e-b5bd-4470-a77d-07b328e4697f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.222708 Jul 19 20:53:40.562398 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 264/495] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:40 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:40.574587 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-30dec8f8-00a1-4e02-abe3-8afea2f4c9ce tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:40.583913 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-30dec8f8-00a1-4e02-abe3-8afea2f4c9ce tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1710 microversion: 2.1 time: 0.228422 Jul 19 20:53:40.584603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 232/496] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:40 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1710 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:41.150009 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a5c23b5a-d5b3-46dc-9c65-25d43280f99d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:41.150822 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a5c23b5a-d5b3-46dc-9c65-25d43280f99d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:41.158645 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a5c23b5a-d5b3-46dc-9c65-25d43280f99d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:41.159086 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a5c23b5a-d5b3-46dc-9c65-25d43280f99d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:41.159965 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a5c23b5a-d5b3-46dc-9c65-25d43280f99d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:41.160467 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a5c23b5a-d5b3-46dc-9c65-25d43280f99d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:41.332113 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-a5c23b5a-d5b3-46dc-9c65-25d43280f99d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:41.341874 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-a5c23b5a-d5b3-46dc-9c65-25d43280f99d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:41.343523 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-a5c23b5a-d5b3-46dc-9c65-25d43280f99d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:41.344771 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a5c23b5a-d5b3-46dc-9c65-25d43280f99d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.199573 Jul 19 20:53:41.345353 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 265/497] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:41 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:41.573800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-918f5e55-f53f-4fe3-9296-adb1fbc22080 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:41.574387 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-918f5e55-f53f-4fe3-9296-adb1fbc22080 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:41.582242 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-918f5e55-f53f-4fe3-9296-adb1fbc22080 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:41.582706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-918f5e55-f53f-4fe3-9296-adb1fbc22080 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:41.583607 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-918f5e55-f53f-4fe3-9296-adb1fbc22080 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:41.584091 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-918f5e55-f53f-4fe3-9296-adb1fbc22080 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:41.725684 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-918f5e55-f53f-4fe3-9296-adb1fbc22080 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:41.734577 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-918f5e55-f53f-4fe3-9296-adb1fbc22080 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.164689 Jul 19 20:53:41.735165 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 233/498] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:41 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:42.364334 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5d5e20a5-e149-4349-b54f-ebae3e111754 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:42.364965 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5d5e20a5-e149-4349-b54f-ebae3e111754 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:42.371913 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5d5e20a5-e149-4349-b54f-ebae3e111754 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:42.372370 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5d5e20a5-e149-4349-b54f-ebae3e111754 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:42.373160 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5d5e20a5-e149-4349-b54f-ebae3e111754 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:42.373673 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5d5e20a5-e149-4349-b54f-ebae3e111754 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:42.512754 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5d5e20a5-e149-4349-b54f-ebae3e111754 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:42.532585 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5d5e20a5-e149-4349-b54f-ebae3e111754 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:42.535093 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5d5e20a5-e149-4349-b54f-ebae3e111754 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:42.536828 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5d5e20a5-e149-4349-b54f-ebae3e111754 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.176539 Jul 19 20:53:42.537417 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 266/499] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:42 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:42.752666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8d995c7a-83a6-4b21-93f8-ebc26d91253e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:42.753238 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8d995c7a-83a6-4b21-93f8-ebc26d91253e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:42.760185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8d995c7a-83a6-4b21-93f8-ebc26d91253e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:42.760641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8d995c7a-83a6-4b21-93f8-ebc26d91253e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:42.761573 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8d995c7a-83a6-4b21-93f8-ebc26d91253e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:42.762027 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8d995c7a-83a6-4b21-93f8-ebc26d91253e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:42.914476 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8d995c7a-83a6-4b21-93f8-ebc26d91253e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:42.923335 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8d995c7a-83a6-4b21-93f8-ebc26d91253e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.175075 Jul 19 20:53:42.923934 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 234/500] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:42 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:43.562434 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6ccaf95e-121b-4608-b99b-50aa4ac201b9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:43.563063 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6ccaf95e-121b-4608-b99b-50aa4ac201b9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:43.570189 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6ccaf95e-121b-4608-b99b-50aa4ac201b9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:43.570641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6ccaf95e-121b-4608-b99b-50aa4ac201b9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:43.571433 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6ccaf95e-121b-4608-b99b-50aa4ac201b9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:43.571873 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6ccaf95e-121b-4608-b99b-50aa4ac201b9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:43.710678 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6ccaf95e-121b-4608-b99b-50aa4ac201b9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:43.720924 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6ccaf95e-121b-4608-b99b-50aa4ac201b9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:43.723100 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6ccaf95e-121b-4608-b99b-50aa4ac201b9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:43.724744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6ccaf95e-121b-4608-b99b-50aa4ac201b9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.167243 Jul 19 20:53:43.725332 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 267/501] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:43 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:43.940359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e860ab8d-e823-4c0c-9a46-af5f8ec81034 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:43.940898 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e860ab8d-e823-4c0c-9a46-af5f8ec81034 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:43.947608 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e860ab8d-e823-4c0c-9a46-af5f8ec81034 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:43.948067 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e860ab8d-e823-4c0c-9a46-af5f8ec81034 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:43.948840 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e860ab8d-e823-4c0c-9a46-af5f8ec81034 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:43.949278 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e860ab8d-e823-4c0c-9a46-af5f8ec81034 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:44.119577 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e860ab8d-e823-4c0c-9a46-af5f8ec81034 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:44.128387 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e860ab8d-e823-4c0c-9a46-af5f8ec81034 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.191960 Jul 19 20:53:44.128975 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 235/502] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:43 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:44.751874 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-10a5579f-e909-4597-8df7-cd79e75d3c17 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:44.753505 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-10a5579f-e909-4597-8df7-cd79e75d3c17 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:44.766669 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-10a5579f-e909-4597-8df7-cd79e75d3c17 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:44.767498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-10a5579f-e909-4597-8df7-cd79e75d3c17 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:44.768983 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-10a5579f-e909-4597-8df7-cd79e75d3c17 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:44.769894 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-10a5579f-e909-4597-8df7-cd79e75d3c17 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:44.939527 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-10a5579f-e909-4597-8df7-cd79e75d3c17 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:44.950257 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-10a5579f-e909-4597-8df7-cd79e75d3c17 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:44.952444 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-10a5579f-e909-4597-8df7-cd79e75d3c17 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:44.953108 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-10a5579f-e909-4597-8df7-cd79e75d3c17 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.211893 Jul 19 20:53:44.953715 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 268/503] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:44 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:53:45.147131 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-25391034-9825-4340-9ef7-d8f55acd9a6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:45.147829 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-25391034-9825-4340-9ef7-d8f55acd9a6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:45.155583 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-25391034-9825-4340-9ef7-d8f55acd9a6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:45.156038 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-25391034-9825-4340-9ef7-d8f55acd9a6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:45.156857 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-25391034-9825-4340-9ef7-d8f55acd9a6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:45.157242 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-25391034-9825-4340-9ef7-d8f55acd9a6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:45.310545 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-25391034-9825-4340-9ef7-d8f55acd9a6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:45.319255 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-25391034-9825-4340-9ef7-d8f55acd9a6d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.176430 Jul 19 20:53:45.319857 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 236/504] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:45 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:45.981756 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-eb136c3f-6ae9-4218-af97-42a50a5c1b9a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:45.983734 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-eb136c3f-6ae9-4218-af97-42a50a5c1b9a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:45.996612 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-eb136c3f-6ae9-4218-af97-42a50a5c1b9a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:45.997619 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-eb136c3f-6ae9-4218-af97-42a50a5c1b9a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:45.999803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-eb136c3f-6ae9-4218-af97-42a50a5c1b9a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:46.000958 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-eb136c3f-6ae9-4218-af97-42a50a5c1b9a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:46.183534 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-eb136c3f-6ae9-4218-af97-42a50a5c1b9a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:46.194616 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-eb136c3f-6ae9-4218-af97-42a50a5c1b9a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:46.196386 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-eb136c3f-6ae9-4218-af97-42a50a5c1b9a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:46.197642 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-eb136c3f-6ae9-4218-af97-42a50a5c1b9a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.224433 Jul 19 20:53:46.198232 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 269/505] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:45 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:46.337823 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a7ba1393-e9e4-4607-b14c-23b5972e24bf tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:46.338455 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a7ba1393-e9e4-4607-b14c-23b5972e24bf tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:46.345872 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a7ba1393-e9e4-4607-b14c-23b5972e24bf tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:46.346387 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a7ba1393-e9e4-4607-b14c-23b5972e24bf tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:46.347845 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a7ba1393-e9e4-4607-b14c-23b5972e24bf tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:46.348626 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a7ba1393-e9e4-4607-b14c-23b5972e24bf tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:46.525264 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a7ba1393-e9e4-4607-b14c-23b5972e24bf tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:46.534214 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a7ba1393-e9e4-4607-b14c-23b5972e24bf tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.200543 Jul 19 20:53:46.535075 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 237/506] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:46 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:47.217823 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9235c49e-b3d4-484e-8bcf-25b93c997ab9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:47.218486 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-9235c49e-b3d4-484e-8bcf-25b93c997ab9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:47.226051 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9235c49e-b3d4-484e-8bcf-25b93c997ab9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:47.226499 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9235c49e-b3d4-484e-8bcf-25b93c997ab9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:47.227262 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9235c49e-b3d4-484e-8bcf-25b93c997ab9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:47.227694 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9235c49e-b3d4-484e-8bcf-25b93c997ab9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:47.376526 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9235c49e-b3d4-484e-8bcf-25b93c997ab9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:47.385743 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9235c49e-b3d4-484e-8bcf-25b93c997ab9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:47.387274 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9235c49e-b3d4-484e-8bcf-25b93c997ab9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:47.388534 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9235c49e-b3d4-484e-8bcf-25b93c997ab9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.175833 Jul 19 20:53:47.389190 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 270/507] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:47 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:47.555761 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-652c2b6f-c08d-4796-83ca-a6187e191760 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:47.556926 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-652c2b6f-c08d-4796-83ca-a6187e191760 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:47.568615 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-652c2b6f-c08d-4796-83ca-a6187e191760 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:47.569427 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-652c2b6f-c08d-4796-83ca-a6187e191760 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:47.570855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-652c2b6f-c08d-4796-83ca-a6187e191760 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:47.571370 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-652c2b6f-c08d-4796-83ca-a6187e191760 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:47.738430 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-652c2b6f-c08d-4796-83ca-a6187e191760 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:47.752034 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-652c2b6f-c08d-4796-83ca-a6187e191760 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.202659 Jul 19 20:53:47.753096 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 238/508] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:47 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:47.903664 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-10b46482-f4c3-489a-adfa-e92b525f71f1 req-291245b1-8469-4be7-afb7-a7a3b1619acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e43f46e-319f-4ec4-8d5a-0e95995dc370", "name": "network-vif-plugged", "status": "completed", "tag": "8f0876b6-27aa-4999-81eb-a3e576f37753"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:53:47.915074 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-10b46482-f4c3-489a-adfa-e92b525f71f1 req-291245b1-8469-4be7-afb7-a7a3b1619acb service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:47.915808 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-10b46482-f4c3-489a-adfa-e92b525f71f1 req-291245b1-8469-4be7-afb7-a7a3b1619acb service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:47.928853 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-10b46482-f4c3-489a-adfa-e92b525f71f1 req-291245b1-8469-4be7-afb7-a7a3b1619acb service nova] Creating event network-vif-plugged:8f0876b6-27aa-4999-81eb-a3e576f37753 for instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 on hv-cinder-79987 Jul 19 20:53:47.934567 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-10b46482-f4c3-489a-adfa-e92b525f71f1 req-291245b1-8469-4be7-afb7-a7a3b1619acb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034775 Jul 19 20:53:47.935098 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 271/509] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:53:48.408127 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d80ce0d4-9bd0-4366-86b5-3e7678880b3a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:48.409118 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d80ce0d4-9bd0-4366-86b5-3e7678880b3a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:48.419015 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d80ce0d4-9bd0-4366-86b5-3e7678880b3a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:48.419766 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d80ce0d4-9bd0-4366-86b5-3e7678880b3a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:48.420986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d80ce0d4-9bd0-4366-86b5-3e7678880b3a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:48.421699 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d80ce0d4-9bd0-4366-86b5-3e7678880b3a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:48.587711 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d80ce0d4-9bd0-4366-86b5-3e7678880b3a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:48.597665 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d80ce0d4-9bd0-4366-86b5-3e7678880b3a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:48.599588 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d80ce0d4-9bd0-4366-86b5-3e7678880b3a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:48.600941 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d80ce0d4-9bd0-4366-86b5-3e7678880b3a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.197070 Jul 19 20:53:48.601545 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 239/510] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:48 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:48.772119 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4bc87524-d220-46c5-aa6f-9a36deabd43d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:48.772770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4bc87524-d220-46c5-aa6f-9a36deabd43d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:48.780520 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4bc87524-d220-46c5-aa6f-9a36deabd43d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:48.781010 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4bc87524-d220-46c5-aa6f-9a36deabd43d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:48.781965 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4bc87524-d220-46c5-aa6f-9a36deabd43d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:48.782907 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4bc87524-d220-46c5-aa6f-9a36deabd43d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:48.960924 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4bc87524-d220-46c5-aa6f-9a36deabd43d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:48.970774 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4bc87524-d220-46c5-aa6f-9a36deabd43d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.204464 Jul 19 20:53:48.971370 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 272/511] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:48 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:49.620841 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-166ff0b7-142f-45fb-8920-da561f10eb39 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:49.621727 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-166ff0b7-142f-45fb-8920-da561f10eb39 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:49.629701 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-166ff0b7-142f-45fb-8920-da561f10eb39 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:49.630183 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-166ff0b7-142f-45fb-8920-da561f10eb39 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:49.630974 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-166ff0b7-142f-45fb-8920-da561f10eb39 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:49.631410 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-166ff0b7-142f-45fb-8920-da561f10eb39 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:49.777540 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-166ff0b7-142f-45fb-8920-da561f10eb39 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:49.787428 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-166ff0b7-142f-45fb-8920-da561f10eb39 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:49.788975 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-166ff0b7-142f-45fb-8920-da561f10eb39 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:49.790299 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-166ff0b7-142f-45fb-8920-da561f10eb39 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.173501 Jul 19 20:53:49.791022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 240/512] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:49 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:49.990367 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0229e11a-df4b-4604-ab8e-fc64a9358261 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:49.990916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0229e11a-df4b-4604-ab8e-fc64a9358261 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:49.997551 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0229e11a-df4b-4604-ab8e-fc64a9358261 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:49.998060 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0229e11a-df4b-4604-ab8e-fc64a9358261 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:49.999160 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0229e11a-df4b-4604-ab8e-fc64a9358261 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:49.999891 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0229e11a-df4b-4604-ab8e-fc64a9358261 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:50.157427 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0229e11a-df4b-4604-ab8e-fc64a9358261 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:50.166433 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0229e11a-df4b-4604-ab8e-fc64a9358261 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.180766 Jul 19 20:53:50.167047 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 273/513] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:49 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:50.813928 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a8524f65-2b6a-45c3-88b6-9a99c5261700 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:50.814815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a8524f65-2b6a-45c3-88b6-9a99c5261700 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:50.823962 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a8524f65-2b6a-45c3-88b6-9a99c5261700 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:50.824751 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a8524f65-2b6a-45c3-88b6-9a99c5261700 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:50.826222 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a8524f65-2b6a-45c3-88b6-9a99c5261700 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:50.827311 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a8524f65-2b6a-45c3-88b6-9a99c5261700 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:51.031670 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a8524f65-2b6a-45c3-88b6-9a99c5261700 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:51.047363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a8524f65-2b6a-45c3-88b6-9a99c5261700 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:51.051244 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a8524f65-2b6a-45c3-88b6-9a99c5261700 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:51.053781 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a8524f65-2b6a-45c3-88b6-9a99c5261700 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1805 microversion: 2.20 time: 0.246134 Jul 19 20:53:51.054770 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 241/514] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:50 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1805 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:53:51.188290 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f69305b4-5ba3-480a-8222-fee3008232ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:51.189068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f69305b4-5ba3-480a-8222-fee3008232ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:51.196025 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f69305b4-5ba3-480a-8222-fee3008232ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:51.196381 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f69305b4-5ba3-480a-8222-fee3008232ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:51.197165 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f69305b4-5ba3-480a-8222-fee3008232ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:51.197637 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f69305b4-5ba3-480a-8222-fee3008232ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:51.383256 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f69305b4-5ba3-480a-8222-fee3008232ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:51.392882 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f69305b4-5ba3-480a-8222-fee3008232ab tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.209151 Jul 19 20:53:51.393512 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 274/515] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:51 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:52.075570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4a0ec2b7-0af7-4c03-902d-d3c6061242eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:52.076342 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4a0ec2b7-0af7-4c03-902d-d3c6061242eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:52.084320 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4a0ec2b7-0af7-4c03-902d-d3c6061242eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:52.084779 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4a0ec2b7-0af7-4c03-902d-d3c6061242eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:52.085615 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4a0ec2b7-0af7-4c03-902d-d3c6061242eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:52.086063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4a0ec2b7-0af7-4c03-902d-d3c6061242eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:52.239564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4a0ec2b7-0af7-4c03-902d-d3c6061242eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:52.256400 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4a0ec2b7-0af7-4c03-902d-d3c6061242eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:52.258243 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4a0ec2b7-0af7-4c03-902d-d3c6061242eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:52.260129 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4a0ec2b7-0af7-4c03-902d-d3c6061242eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1792 microversion: 2.20 time: 0.188707 Jul 19 20:53:52.260986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 242/516] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:53:52 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1792 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:53:52.412438 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b1a3df2f-77de-4e63-b80f-b99fba5b5d35 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:52.413063 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b1a3df2f-77de-4e63-b80f-b99fba5b5d35 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:52.420921 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b1a3df2f-77de-4e63-b80f-b99fba5b5d35 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:52.421410 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b1a3df2f-77de-4e63-b80f-b99fba5b5d35 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:52.422212 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b1a3df2f-77de-4e63-b80f-b99fba5b5d35 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:52.422791 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b1a3df2f-77de-4e63-b80f-b99fba5b5d35 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:52.571978 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b1a3df2f-77de-4e63-b80f-b99fba5b5d35 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:52.580846 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b1a3df2f-77de-4e63-b80f-b99fba5b5d35 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.172769 Jul 19 20:53:52.581481 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 275/517] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:52 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:53.599479 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-962f21ab-1115-4428-895f-20dc34d82a5c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:53.600143 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-962f21ab-1115-4428-895f-20dc34d82a5c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:53.607177 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-962f21ab-1115-4428-895f-20dc34d82a5c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:53.608279 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-962f21ab-1115-4428-895f-20dc34d82a5c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:53.609068 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-962f21ab-1115-4428-895f-20dc34d82a5c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:53.609543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-962f21ab-1115-4428-895f-20dc34d82a5c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:53.754517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-962f21ab-1115-4428-895f-20dc34d82a5c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:53.765057 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-962f21ab-1115-4428-895f-20dc34d82a5c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.169782 Jul 19 20:53:53.765684 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 243/518] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:53 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:54.786064 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5f06b94f-1d17-426b-94eb-a84684310ed8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:54.787643 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5f06b94f-1d17-426b-94eb-a84684310ed8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:54.797520 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f06b94f-1d17-426b-94eb-a84684310ed8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:54.798119 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f06b94f-1d17-426b-94eb-a84684310ed8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:54.799015 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f06b94f-1d17-426b-94eb-a84684310ed8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:54.799549 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f06b94f-1d17-426b-94eb-a84684310ed8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:54.804538 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:54.989213 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5f06b94f-1d17-426b-94eb-a84684310ed8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:54.997788 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5f06b94f-1d17-426b-94eb-a84684310ed8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.218122 Jul 19 20:53:54.998412 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 276/519] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:54 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:56.024725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-1ed8479f-dec7-4f90-a3f5-0582307ffe2c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:56.025434 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-1ed8479f-dec7-4f90-a3f5-0582307ffe2c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:56.032495 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1ed8479f-dec7-4f90-a3f5-0582307ffe2c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:56.032966 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1ed8479f-dec7-4f90-a3f5-0582307ffe2c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:56.033850 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1ed8479f-dec7-4f90-a3f5-0582307ffe2c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:56.034290 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1ed8479f-dec7-4f90-a3f5-0582307ffe2c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:56.266180 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1ed8479f-dec7-4f90-a3f5-0582307ffe2c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:56.281750 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-1ed8479f-dec7-4f90-a3f5-0582307ffe2c tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.260478 Jul 19 20:53:56.282895 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 244/520] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:56 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:53:57.301610 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5fbc1bd7-17a8-458b-840e-a58804a5ac01 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:57.302381 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5fbc1bd7-17a8-458b-840e-a58804a5ac01 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:57.309552 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5fbc1bd7-17a8-458b-840e-a58804a5ac01 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:57.310089 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5fbc1bd7-17a8-458b-840e-a58804a5ac01 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:57.310807 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5fbc1bd7-17a8-458b-840e-a58804a5ac01 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:57.311242 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5fbc1bd7-17a8-458b-840e-a58804a5ac01 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:57.510866 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5fbc1bd7-17a8-458b-840e-a58804a5ac01 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:57.523624 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5fbc1bd7-17a8-458b-840e-a58804a5ac01 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.225849 Jul 19 20:53:57.524374 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 277/521] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:57 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:58.542933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e923b831-0254-42cd-9379-09c3a78f508a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:58.543573 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e923b831-0254-42cd-9379-09c3a78f508a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:58.551433 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e923b831-0254-42cd-9379-09c3a78f508a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:58.551968 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e923b831-0254-42cd-9379-09c3a78f508a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:58.553013 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e923b831-0254-42cd-9379-09c3a78f508a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:58.553600 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e923b831-0254-42cd-9379-09c3a78f508a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:58.558694 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=100 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:58.953525 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e923b831-0254-42cd-9379-09c3a78f508a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:53:58.962830 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e923b831-0254-42cd-9379-09c3a78f508a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1735 microversion: 2.1 time: 0.423791 Jul 19 20:53:58.963444 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 245/522] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:58 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1735 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:53:59.982206 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-635d0f9b-7815-4cdc-8a37-1790b4384c17 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:53:59.983058 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-635d0f9b-7815-4cdc-8a37-1790b4384c17 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:53:59.990438 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-635d0f9b-7815-4cdc-8a37-1790b4384c17 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:59.990890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-635d0f9b-7815-4cdc-8a37-1790b4384c17 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:59.991675 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-635d0f9b-7815-4cdc-8a37-1790b4384c17 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:59.992119 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-635d0f9b-7815-4cdc-8a37-1790b4384c17 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:00.185244 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-635d0f9b-7815-4cdc-8a37-1790b4384c17 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:00.200204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-635d0f9b-7815-4cdc-8a37-1790b4384c17 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1715 microversion: 2.1 time: 0.221815 Jul 19 20:54:00.201278 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 278/523] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:53:59 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1715 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:00.358039 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-736f3d08-720e-4d5b-965e-63eedffe11d0 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:00.358805 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-736f3d08-720e-4d5b-965e-63eedffe11d0 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:00.369079 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-736f3d08-720e-4d5b-965e-63eedffe11d0 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:00.370134 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-736f3d08-720e-4d5b-965e-63eedffe11d0 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:00.371306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-736f3d08-720e-4d5b-965e-63eedffe11d0 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:00.372006 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-736f3d08-720e-4d5b-965e-63eedffe11d0 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:00.551087 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-736f3d08-720e-4d5b-965e-63eedffe11d0 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] HTTP exception thrown: Cannot 'detach_volume' instance 272b6112-4d76-4d2f-84ab-4382b998c781 while it is in vm_state rescued Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-736f3d08-720e-4d5b-965e-63eedffe11d0 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Request method failure captured: Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: DELETE /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments/4d3d5f13-1b6a-4935-afc9-07fc1577f933 HTTP/1.1 Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjIeNeE6tE-ebPrmYqZLKOkhuEvhTtzR4zG55Oz6qsVbdRt6XJd2QG1rQJo8ir8u5ycQmi1GJQ_v731GDE9SPVFb5LbYPGDcqwGAm-YQz_uafBtTUZcjuOM6phW7UenFGjceuk_FrYndKcIKfU_iLxW2cbkWvBF0_JuN3GJ10NFEiM Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 6cc474e26dd8444b99645279c4d133bf Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:54:00.552800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:54:00.555301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6cc474e26dd8444b99645279c4d133bf", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:54:00.555301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:54:00.555301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 6cc474e26dd8444b99645279c4d133bf Jul 19 20:54:00.555301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:54:00.555301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-ServerRescueNegativeTestJSON-1650342896-project Jul 19 20:54:00.555301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:54:00.555301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:54:00.555301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: 9fa96f51390e46e991c6e9afa385d2f7 Jul 19 20:54:00.555301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1650342896-project Jul 19 20:54:00.555301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:54:00.555301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Cannot 'detach_volume' instance 272b6112-4d76-4d2f-84ab-4382b998c781 while it is in vm_state rescued Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'server_id': '272b6112-4d76-4d2f-84ab-4382b998c781', 'id': '4d3d5f13-1b6a-4935-afc9-07fc1577f933'} Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 272b6112-4d76-4d2f-84ab-4382b998c781 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:54:00.556643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 272b6112-4d76-4d2f-84ab-4382b998c781 while it is in vm_state rescued Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 272b6112-4d76-4d2f-84ab-4382b998c781 while it is in vm_state rescued Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:00.559170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-736f3d08-720e-4d5b-965e-63eedffe11d0 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Returning 409 to user: Cannot 'detach_volume' instance 272b6112-4d76-4d2f-84ab-4382b998c781 while it is in vm_state rescued {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:54:00.561344 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-736f3d08-720e-4d5b-965e-63eedffe11d0 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "DELETE /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments/4d3d5f13-1b6a-4935-afc9-07fc1577f933" status: 409 len: 152 microversion: 2.1 time: 0.201362 Jul 19 20:54:00.561344 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 246/524] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jul 19 20:54:00 2022] DELETE /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments/4d3d5f13-1b6a-4935-afc9-07fc1577f933 => generated 152 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:54:00.567478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-00c5f430-ffbf-41e9-82c8-a17360ff00ff tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:00.568177 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-00c5f430-ffbf-41e9-82c8-a17360ff00ff tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:00.570635 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=50 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:00.576470 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-00c5f430-ffbf-41e9-82c8-a17360ff00ff tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:00.576929 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-00c5f430-ffbf-41e9-82c8-a17360ff00ff tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:00.577777 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-00c5f430-ffbf-41e9-82c8-a17360ff00ff tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:00.578217 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-00c5f430-ffbf-41e9-82c8-a17360ff00ff tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:00.658347 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-00c5f430-ffbf-41e9-82c8-a17360ff00ff tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "POST /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/action" status: 202 len: 0 microversion: 2.1 time: 0.097108 Jul 19 20:54:00.658992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 279/525] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 20:54:00 2022] POST /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:54:00.670417 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a31b947f-8101-459c-8d87-a0d54ff1b636 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:00.671307 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a31b947f-8101-459c-8d87-a0d54ff1b636 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:00.682010 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a31b947f-8101-459c-8d87-a0d54ff1b636 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:00.682830 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a31b947f-8101-459c-8d87-a0d54ff1b636 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:00.684083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a31b947f-8101-459c-8d87-a0d54ff1b636 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:00.684541 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a31b947f-8101-459c-8d87-a0d54ff1b636 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:00.906329 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a31b947f-8101-459c-8d87-a0d54ff1b636 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:00.917855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a31b947f-8101-459c-8d87-a0d54ff1b636 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1723 microversion: 2.1 time: 0.253874 Jul 19 20:54:00.918647 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 247/526] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:00 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:01.951062 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c6b6b8ad-b4c7-44f5-898a-b6c3a683b9ee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:01.952817 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c6b6b8ad-b4c7-44f5-898a-b6c3a683b9ee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:01.964141 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c6b6b8ad-b4c7-44f5-898a-b6c3a683b9ee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:01.964982 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c6b6b8ad-b4c7-44f5-898a-b6c3a683b9ee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:01.966405 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c6b6b8ad-b4c7-44f5-898a-b6c3a683b9ee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:01.967939 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c6b6b8ad-b4c7-44f5-898a-b6c3a683b9ee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:02.130666 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c6b6b8ad-b4c7-44f5-898a-b6c3a683b9ee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:02.139628 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c6b6b8ad-b4c7-44f5-898a-b6c3a683b9ee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1723 microversion: 2.1 time: 0.196792 Jul 19 20:54:02.140260 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 280/527] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:01 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:03.159457 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-92196e15-f841-484d-967c-6292b14af50a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:03.160308 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-92196e15-f841-484d-967c-6292b14af50a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:03.162546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=52 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:03.169179 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-92196e15-f841-484d-967c-6292b14af50a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:03.169667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-92196e15-f841-484d-967c-6292b14af50a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:03.171057 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-92196e15-f841-484d-967c-6292b14af50a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:03.171499 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-92196e15-f841-484d-967c-6292b14af50a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:03.350883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-92196e15-f841-484d-967c-6292b14af50a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:03.359997 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-92196e15-f841-484d-967c-6292b14af50a tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1723 microversion: 2.1 time: 0.204542 Jul 19 20:54:03.360596 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 248/528] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:03 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:04.381941 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6a7b7aa9-abeb-4cd0-ab8f-179aec0b3e87 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:04.383016 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6a7b7aa9-abeb-4cd0-ab8f-179aec0b3e87 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:04.393012 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6a7b7aa9-abeb-4cd0-ab8f-179aec0b3e87 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:04.393568 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6a7b7aa9-abeb-4cd0-ab8f-179aec0b3e87 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:04.394493 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6a7b7aa9-abeb-4cd0-ab8f-179aec0b3e87 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:04.394939 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6a7b7aa9-abeb-4cd0-ab8f-179aec0b3e87 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:04.579280 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6a7b7aa9-abeb-4cd0-ab8f-179aec0b3e87 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:04.593969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6a7b7aa9-abeb-4cd0-ab8f-179aec0b3e87 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1723 microversion: 2.1 time: 0.218349 Jul 19 20:54:04.594901 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 281/529] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:04 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:05.619690 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f30c64d3-f518-4eee-a38b-1074e7543ea6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:05.620331 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f30c64d3-f518-4eee-a38b-1074e7543ea6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:05.627050 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f30c64d3-f518-4eee-a38b-1074e7543ea6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:05.627406 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f30c64d3-f518-4eee-a38b-1074e7543ea6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:05.628198 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f30c64d3-f518-4eee-a38b-1074e7543ea6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:05.628644 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f30c64d3-f518-4eee-a38b-1074e7543ea6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:05.773222 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f30c64d3-f518-4eee-a38b-1074e7543ea6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:05.788754 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f30c64d3-f518-4eee-a38b-1074e7543ea6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1729 microversion: 2.1 time: 0.173645 Jul 19 20:54:05.789823 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 249/530] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:05 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:05.814244 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e5da1e01-5450-4714-8440-a6484b6dd14f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:05.814958 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e5da1e01-5450-4714-8440-a6484b6dd14f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:05.826064 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e5da1e01-5450-4714-8440-a6484b6dd14f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:05.827342 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e5da1e01-5450-4714-8440-a6484b6dd14f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:05.828633 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e5da1e01-5450-4714-8440-a6484b6dd14f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:05.829469 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e5da1e01-5450-4714-8440-a6484b6dd14f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:05.921046 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e5da1e01-5450-4714-8440-a6484b6dd14f tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112134 Jul 19 20:54:05.922674 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 282/531] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jul 19 20:54:05 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:07.334278 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-dac0faa0-8a4b-4feb-8fce-db7fe2e6a043 req-318b0eb1-1435-4a7a-8436-070ade1cc016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272b6112-4d76-4d2f-84ab-4382b998c781", "tag": "c39b17d3-41ea-48aa-ace5-2a3ac46873d7"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:07.351060 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-dac0faa0-8a4b-4feb-8fce-db7fe2e6a043 req-318b0eb1-1435-4a7a-8436-070ade1cc016 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:07.352000 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-dac0faa0-8a4b-4feb-8fce-db7fe2e6a043 req-318b0eb1-1435-4a7a-8436-070ade1cc016 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:07.377770 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-dac0faa0-8a4b-4feb-8fce-db7fe2e6a043 req-318b0eb1-1435-4a7a-8436-070ade1cc016 service nova] Creating event network-changed:c39b17d3-41ea-48aa-ace5-2a3ac46873d7 for instance 272b6112-4d76-4d2f-84ab-4382b998c781 on hv-cinder-79987 Jul 19 20:54:07.386437 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-dac0faa0-8a4b-4feb-8fce-db7fe2e6a043 req-318b0eb1-1435-4a7a-8436-070ade1cc016 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058485 Jul 19 20:54:07.386845 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 250/532] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:54:09.403901 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-9963bfe1-9962-4d31-8f60-5b438efcf784 req-40a3c175-74ac-4781-8f7d-bd501d4e2687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272b6112-4d76-4d2f-84ab-4382b998c781", "tag": "c39b17d3-41ea-48aa-ace5-2a3ac46873d7"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:09.411952 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-9963bfe1-9962-4d31-8f60-5b438efcf784 req-40a3c175-74ac-4781-8f7d-bd501d4e2687 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:09.412396 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-9963bfe1-9962-4d31-8f60-5b438efcf784 req-40a3c175-74ac-4781-8f7d-bd501d4e2687 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:09.423494 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-9963bfe1-9962-4d31-8f60-5b438efcf784 req-40a3c175-74ac-4781-8f7d-bd501d4e2687 service nova] Creating event network-changed:c39b17d3-41ea-48aa-ace5-2a3ac46873d7 for instance 272b6112-4d76-4d2f-84ab-4382b998c781 on hv-cinder-79987 Jul 19 20:54:09.428423 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-9963bfe1-9962-4d31-8f60-5b438efcf784 req-40a3c175-74ac-4781-8f7d-bd501d4e2687 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028760 Jul 19 20:54:09.429016 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 283/533] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:42.481697 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=5 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:42.482435 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=30 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:42.549564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e0751199-2b5e-4308-98d5-898ef1888038 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:42.550154 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e0751199-2b5e-4308-98d5-898ef1888038 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:42.556438 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e0751199-2b5e-4308-98d5-898ef1888038 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:42.556884 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e0751199-2b5e-4308-98d5-898ef1888038 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:42.557690 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e0751199-2b5e-4308-98d5-898ef1888038 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:42.558132 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e0751199-2b5e-4308-98d5-898ef1888038 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:42.581670 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e0751199-2b5e-4308-98d5-898ef1888038 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab/ips" status: 200 len: 149 microversion: 2.1 time: 0.101696 Jul 19 20:54:42.582224 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 251/534] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jul 19 20:54:42 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab/ips => generated 149 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:42.590638 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=9 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:42.591383 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:42.596578 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6f0e5d89-091c-4711-91f5-af9a09f86b2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a65addde-b40c-45a1-9d99-e93362c7223e"}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:42.597745 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6f0e5d89-091c-4711-91f5-af9a09f86b2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:42.605448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6f0e5d89-091c-4711-91f5-af9a09f86b2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:42.605936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6f0e5d89-091c-4711-91f5-af9a09f86b2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:42.606695 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6f0e5d89-091c-4711-91f5-af9a09f86b2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:42.607126 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6f0e5d89-091c-4711-91f5-af9a09f86b2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:42.690382 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-6f0e5d89-091c-4711-91f5-af9a09f86b2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Invalid volume: volume a65addde-b40c-45a1-9d99-e93362c7223e is already attached to instances: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6f0e5d89-091c-4711-91f5-af9a09f86b2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: POST /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab/os-volume_attachments HTTP/1.1 Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 74 Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:54:42.692337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:54:42.693950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:54:42.693950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:54:42.693950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:54:42.693950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:54:42.693950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:54:42.693950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:54:42.693950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:54:42.693950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:54:42.693950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:54:42.693950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Jul 19 20:54:42.693950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {"volumeAttachment": {"volumeId": "a65addde-b40c-45a1-9d99-e93362c7223e"}} Jul 19 20:54:42.693950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Invalid volume: volume a65addde-b40c-45a1-9d99-e93362c7223e is already attached to instances: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'server_id': '30f2c53f-06f9-4306-82e4-df8af346dbab', 'body': {'volumeAttachment': {'volumeId': 'a65addde-b40c-45a1-9d99-e93362c7223e'}}} Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a65addde-b40c-45a1-9d99-e93362c7223e is already attached to instances: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:54:42.694770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a65addde-b40c-45a1-9d99-e93362c7223e is already attached to instances: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:42.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:42.697096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:42.697096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:54:42.697096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:54:42.697096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a65addde-b40c-45a1-9d99-e93362c7223e is already attached to instances: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 Jul 19 20:54:42.697096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:54:42.697096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6f0e5d89-091c-4711-91f5-af9a09f86b2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 400 to user: Invalid volume: volume a65addde-b40c-45a1-9d99-e93362c7223e is already attached to instances: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:54:42.697096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6f0e5d89-091c-4711-91f5-af9a09f86b2b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104884 Jul 19 20:54:42.697096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 284/535] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 20:54:42 2022] POST /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:54:42.703286 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-82187e8e-2de9-4e7d-81f0-d7543a912265 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:42.703749 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-82187e8e-2de9-4e7d-81f0-d7543a912265 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:42.710014 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-82187e8e-2de9-4e7d-81f0-d7543a912265 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:42.710462 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-82187e8e-2de9-4e7d-81f0-d7543a912265 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:42.711239 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-82187e8e-2de9-4e7d-81f0-d7543a912265 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:42.711682 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-82187e8e-2de9-4e7d-81f0-d7543a912265 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:42.741097 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-82187e8e-2de9-4e7d-81f0-d7543a912265 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:54:42.857032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-82187e8e-2de9-4e7d-81f0-d7543a912265 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 204 len: 0 microversion: 2.1 time: 0.157776 Jul 19 20:54:42.857612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 252/536] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:54:42 2022] DELETE /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:54:42.866547 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3b5d9041-ba9f-4098-9c4c-d6e947871d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:42.867163 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3b5d9041-ba9f-4098-9c4c-d6e947871d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:42.874786 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3b5d9041-ba9f-4098-9c4c-d6e947871d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:42.875238 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3b5d9041-ba9f-4098-9c4c-d6e947871d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:42.876026 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3b5d9041-ba9f-4098-9c4c-d6e947871d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:42.876470 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3b5d9041-ba9f-4098-9c4c-d6e947871d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:43.034572 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3b5d9041-ba9f-4098-9c4c-d6e947871d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:43.043683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3b5d9041-ba9f-4098-9c4c-d6e947871d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1679 microversion: 2.1 time: 0.181336 Jul 19 20:54:43.044410 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 285/537] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:42 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:44.063666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c85360c1-103d-4c7b-8157-efa214900e6f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:44.064357 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c85360c1-103d-4c7b-8157-efa214900e6f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:44.071297 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c85360c1-103d-4c7b-8157-efa214900e6f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:44.071746 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c85360c1-103d-4c7b-8157-efa214900e6f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:44.072517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c85360c1-103d-4c7b-8157-efa214900e6f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:44.072952 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c85360c1-103d-4c7b-8157-efa214900e6f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:44.234837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c85360c1-103d-4c7b-8157-efa214900e6f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:44.242816 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c85360c1-103d-4c7b-8157-efa214900e6f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1679 microversion: 2.1 time: 0.183357 Jul 19 20:54:44.243420 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 253/538] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:44 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:45.264371 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-00e1d257-0be4-4cc9-b57e-3c45075f5556 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:45.264999 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-00e1d257-0be4-4cc9-b57e-3c45075f5556 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:45.272140 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-00e1d257-0be4-4cc9-b57e-3c45075f5556 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:45.272510 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-00e1d257-0be4-4cc9-b57e-3c45075f5556 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:45.273268 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-00e1d257-0be4-4cc9-b57e-3c45075f5556 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:45.273733 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-00e1d257-0be4-4cc9-b57e-3c45075f5556 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:45.461676 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-00e1d257-0be4-4cc9-b57e-3c45075f5556 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:45.474104 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-00e1d257-0be4-4cc9-b57e-3c45075f5556 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1679 microversion: 2.1 time: 0.213116 Jul 19 20:54:45.475106 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 286/539] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:45 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:46.233550 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-2b835f45-7fe9-4726-bf16-dc115e8b2629 req-f114e26f-305b-4450-9759-ba1ef654bd03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f2c53f-06f9-4306-82e4-df8af346dbab", "name": "network-vif-deleted", "tag": "25c1ba5d-6162-4252-a7d2-1fc981c53132"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:46.249192 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-2b835f45-7fe9-4726-bf16-dc115e8b2629 req-f114e26f-305b-4450-9759-ba1ef654bd03 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:46.250230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-2b835f45-7fe9-4726-bf16-dc115e8b2629 req-f114e26f-305b-4450-9759-ba1ef654bd03 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:46.270087 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-2b835f45-7fe9-4726-bf16-dc115e8b2629 req-f114e26f-305b-4450-9759-ba1ef654bd03 service nova] Creating event network-vif-deleted:25c1ba5d-6162-4252-a7d2-1fc981c53132 for instance 30f2c53f-06f9-4306-82e4-df8af346dbab on hv-cinder-79987 Jul 19 20:54:46.284683 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-2b835f45-7fe9-4726-bf16-dc115e8b2629 req-f114e26f-305b-4450-9759-ba1ef654bd03 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152957 Jul 19 20:54:46.285802 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 254/540] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:54:46.500366 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4742876b-9547-4c63-9e1a-724f815b8921 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:46.501311 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4742876b-9547-4c63-9e1a-724f815b8921 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:46.514341 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4742876b-9547-4c63-9e1a-724f815b8921 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:46.515091 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4742876b-9547-4c63-9e1a-724f815b8921 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:46.516764 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4742876b-9547-4c63-9e1a-724f815b8921 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:46.517835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4742876b-9547-4c63-9e1a-724f815b8921 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:46.582631 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4742876b-9547-4c63-9e1a-724f815b8921 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:46.583096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4742876b-9547-4c63-9e1a-724f815b8921 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:46.583566 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-4742876b-9547-4c63-9e1a-724f815b8921 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lazy-loading 'fault' on Instance uuid 30f2c53f-06f9-4306-82e4-df8af346dbab {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:54:46.647420 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4742876b-9547-4c63-9e1a-724f815b8921 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:46.660164 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4742876b-9547-4c63-9e1a-724f815b8921 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 200 len: 1330 microversion: 2.1 time: 0.167888 Jul 19 20:54:46.662503 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 287/541] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:46 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 1330 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:47.683604 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-eea48581-f160-46e2-917a-fa1db4337d27 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:47.684745 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-eea48581-f160-46e2-917a-fa1db4337d27 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:47.696321 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-eea48581-f160-46e2-917a-fa1db4337d27 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:47.696954 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-eea48581-f160-46e2-917a-fa1db4337d27 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:47.698333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-eea48581-f160-46e2-917a-fa1db4337d27 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:47.699110 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-eea48581-f160-46e2-917a-fa1db4337d27 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:47.723587 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-eea48581-f160-46e2-917a-fa1db4337d27 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-eea48581-f160-46e2-917a-fa1db4337d27 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab HTTP/1.1 Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:54:47.727725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:54:47.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:54:47.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:54:47.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:54:47.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:54:47.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:54:47.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:54:47.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:54:47.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:54:47.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:54:47.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:54:47.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:54:47.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '30f2c53f-06f9-4306-82e4-df8af346dbab'} Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:54:47.730557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:54:47.732772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:47.735159 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-eea48581-f160-46e2-917a-fa1db4337d27 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 404 to user: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:54:47.735159 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-eea48581-f160-46e2-917a-fa1db4337d27 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 404 len: 111 microversion: 2.1 time: 0.052205 Jul 19 20:54:47.735159 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 255/542] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:47 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:54:47.749793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-de65b275-7973-4269-a670-b7cffdb979e3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '.version_select at 0x7f25340f89d0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:47.771679 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-de65b275-7973-4269-a670-b7cffdb979e3 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-698271214" status: 202 len: 0 microversion: 2.1 time: 0.032199 Jul 19 20:54:47.772275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 288/543] 10.222.0.70 () {58 vars in 1217 bytes} [Tue Jul 19 20:54:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-698271214 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:54:48.104615 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e3d50a65-677d-4b9b-a3e8-c614f2f21708 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:48.104813 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e3d50a65-677d-4b9b-a3e8-c614f2f21708 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:48.112150 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e3d50a65-677d-4b9b-a3e8-c614f2f21708 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:48.112508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e3d50a65-677d-4b9b-a3e8-c614f2f21708 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:48.113634 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e3d50a65-677d-4b9b-a3e8-c614f2f21708 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:48.114082 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e3d50a65-677d-4b9b-a3e8-c614f2f21708 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:48.224648 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-e3d50a65-677d-4b9b-a3e8-c614f2f21708 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lazy-loading 'services' on Instance uuid c44e702b-f4f1-46e4-8552-a9440c7b13db {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:54:48.378295 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e3d50a65-677d-4b9b-a3e8-c614f2f21708 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/os-volume_attachments/aa68e593-ced8-4ba8-9c84-92a240f8e848" status: 202 len: 0 microversion: 2.1 time: 0.277346 Jul 19 20:54:48.396665 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 256/544] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jul 19 20:54:48 2022] DELETE /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/os-volume_attachments/aa68e593-ced8-4ba8-9c84-92a240f8e848 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:54:48.768351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f3fd9e5b-9f43-498a-ab87-1b42fe737d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:48.769681 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f3fd9e5b-9f43-498a-ab87-1b42fe737d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:48.777242 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f3fd9e5b-9f43-498a-ab87-1b42fe737d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:48.777813 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f3fd9e5b-9f43-498a-ab87-1b42fe737d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:48.778599 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f3fd9e5b-9f43-498a-ab87-1b42fe737d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:48.779040 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f3fd9e5b-9f43-498a-ab87-1b42fe737d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:48.941437 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-f3fd9e5b-9f43-498a-ab87-1b42fe737d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lazy-loading 'services' on Instance uuid 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:54:49.106723 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f3fd9e5b-9f43-498a-ab87-1b42fe737d1f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/os-volume_attachments/a65addde-b40c-45a1-9d99-e93362c7223e" status: 202 len: 0 microversion: 2.1 time: 0.343684 Jul 19 20:54:49.107357 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 289/545] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jul 19 20:54:48 2022] DELETE /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/os-volume_attachments/a65addde-b40c-45a1-9d99-e93362c7223e => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:54:49.119407 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-01a1437d-b85e-4cd5-841b-be637d8f7d00 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:49.120602 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-01a1437d-b85e-4cd5-841b-be637d8f7d00 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:49.127938 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-01a1437d-b85e-4cd5-841b-be637d8f7d00 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.128395 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-01a1437d-b85e-4cd5-841b-be637d8f7d00 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.129179 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-01a1437d-b85e-4cd5-841b-be637d8f7d00 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.129644 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-01a1437d-b85e-4cd5-841b-be637d8f7d00 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.167880 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-01a1437d-b85e-4cd5-841b-be637d8f7d00 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055090 Jul 19 20:54:49.168550 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 257/546] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:54:49 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:49.552986 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2e18a11b-3473-475e-9f54-a834552780ad tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:49.559483 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2e18a11b-3473-475e-9f54-a834552780ad tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.559931 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2e18a11b-3473-475e-9f54-a834552780ad tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.587056 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2e18a11b-3473-475e-9f54-a834552780ad tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Going to try to stop instance {{(pid=129866) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 20:54:49.640502 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2e18a11b-3473-475e-9f54-a834552780ad tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "POST /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/action" status: 202 len: 0 microversion: 2.1 time: 0.091336 Jul 19 20:54:49.648347 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 290/547] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 20:54:49 2022] POST /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:54:49.657681 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b89eba4a-7898-41e3-83ef-7a1c0f928a0c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:49.658828 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b89eba4a-7898-41e3-83ef-7a1c0f928a0c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:49.669223 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b89eba4a-7898-41e3-83ef-7a1c0f928a0c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.670070 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b89eba4a-7898-41e3-83ef-7a1c0f928a0c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.672011 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b89eba4a-7898-41e3-83ef-7a1c0f928a0c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.672793 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b89eba4a-7898-41e3-83ef-7a1c0f928a0c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.872465 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b89eba4a-7898-41e3-83ef-7a1c0f928a0c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:49.880537 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b89eba4a-7898-41e3-83ef-7a1c0f928a0c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1674 microversion: 2.1 time: 0.230462 Jul 19 20:54:49.881134 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 258/548] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:49 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1674 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:50.187059 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-71ba875f-d93c-4529-946f-468cf0b380a1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:50.188351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-71ba875f-d93c-4529-946f-468cf0b380a1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:50.197758 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71ba875f-d93c-4529-946f-468cf0b380a1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:50.198281 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71ba875f-d93c-4529-946f-468cf0b380a1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:50.199435 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71ba875f-d93c-4529-946f-468cf0b380a1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:50.200117 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71ba875f-d93c-4529-946f-468cf0b380a1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:50.245895 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-71ba875f-d93c-4529-946f-468cf0b380a1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067262 Jul 19 20:54:50.246803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 291/549] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:54:50 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:50.897850 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-08e8f33a-939c-41e4-b390-7e6c8c9c1904 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:50.898445 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-08e8f33a-939c-41e4-b390-7e6c8c9c1904 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:50.905292 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-08e8f33a-939c-41e4-b390-7e6c8c9c1904 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:50.905779 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-08e8f33a-939c-41e4-b390-7e6c8c9c1904 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:50.906555 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-08e8f33a-939c-41e4-b390-7e6c8c9c1904 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:50.906999 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-08e8f33a-939c-41e4-b390-7e6c8c9c1904 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.044500 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-08e8f33a-939c-41e4-b390-7e6c8c9c1904 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:51.052940 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-08e8f33a-939c-41e4-b390-7e6c8c9c1904 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1674 microversion: 2.1 time: 0.158875 Jul 19 20:54:51.053546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 259/550] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:50 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:51.258507 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-db899692-6357-4e3c-a9fa-a017c5bd6577 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:51.259419 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-db899692-6357-4e3c-a9fa-a017c5bd6577 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:51.266259 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-db899692-6357-4e3c-a9fa-a017c5bd6577 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.266711 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-db899692-6357-4e3c-a9fa-a017c5bd6577 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.267481 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-db899692-6357-4e3c-a9fa-a017c5bd6577 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.267916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-db899692-6357-4e3c-a9fa-a017c5bd6577 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.305800 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-db899692-6357-4e3c-a9fa-a017c5bd6577 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051155 Jul 19 20:54:51.306356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 292/551] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:54:51 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:54:51.370362 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-410f9ba2-d903-4a69-a8d8-2f505d66822e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:51.370863 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-410f9ba2-d903-4a69-a8d8-2f505d66822e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:51.379963 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-410f9ba2-d903-4a69-a8d8-2f505d66822e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.380411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-410f9ba2-d903-4a69-a8d8-2f505d66822e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.381217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-410f9ba2-d903-4a69-a8d8-2f505d66822e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.381687 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-410f9ba2-d903-4a69-a8d8-2f505d66822e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.411462 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-410f9ba2-d903-4a69-a8d8-2f505d66822e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:54:51.508674 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-410f9ba2-d903-4a69-a8d8-2f505d66822e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 204 len: 0 microversion: 2.1 time: 0.141935 Jul 19 20:54:51.509224 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 260/552] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:54:51 2022] DELETE /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:54:51.518821 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-92072cfc-68b7-4618-9352-57af04177bf0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:51.519421 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-92072cfc-68b7-4618-9352-57af04177bf0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:51.525665 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-92072cfc-68b7-4618-9352-57af04177bf0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.526109 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-92072cfc-68b7-4618-9352-57af04177bf0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.526873 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-92072cfc-68b7-4618-9352-57af04177bf0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.527302 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-92072cfc-68b7-4618-9352-57af04177bf0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.671976 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-92072cfc-68b7-4618-9352-57af04177bf0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:51.682101 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-92072cfc-68b7-4618-9352-57af04177bf0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1682 microversion: 2.1 time: 0.167740 Jul 19 20:54:51.682683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 293/553] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:51 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:52.071489 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-bafb1550-fc62-4b90-a856-030cb24b1a95 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:52.072216 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-bafb1550-fc62-4b90-a856-030cb24b1a95 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:52.079487 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bafb1550-fc62-4b90-a856-030cb24b1a95 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:52.079962 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bafb1550-fc62-4b90-a856-030cb24b1a95 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:52.080735 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bafb1550-fc62-4b90-a856-030cb24b1a95 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:52.081168 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bafb1550-fc62-4b90-a856-030cb24b1a95 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:52.218876 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-bafb1550-fc62-4b90-a856-030cb24b1a95 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:52.226846 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-bafb1550-fc62-4b90-a856-030cb24b1a95 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1674 microversion: 2.1 time: 0.159592 Jul 19 20:54:52.227483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 261/554] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:52 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:52.700247 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-765f30e8-9bc5-4915-977d-ecad8285459a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:52.700947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-765f30e8-9bc5-4915-977d-ecad8285459a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:52.707622 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-765f30e8-9bc5-4915-977d-ecad8285459a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:52.708064 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-765f30e8-9bc5-4915-977d-ecad8285459a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:52.708827 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-765f30e8-9bc5-4915-977d-ecad8285459a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:52.709256 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-765f30e8-9bc5-4915-977d-ecad8285459a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:52.846907 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-765f30e8-9bc5-4915-977d-ecad8285459a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:52.855640 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-765f30e8-9bc5-4915-977d-ecad8285459a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1682 microversion: 2.1 time: 0.159309 Jul 19 20:54:52.856349 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 294/555] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:52 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:53.244035 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-72c0d1df-a281-419b-a41f-127ec3585c16 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:53.244643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-72c0d1df-a281-419b-a41f-127ec3585c16 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:53.252250 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-72c0d1df-a281-419b-a41f-127ec3585c16 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:53.252741 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-72c0d1df-a281-419b-a41f-127ec3585c16 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:53.253603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-72c0d1df-a281-419b-a41f-127ec3585c16 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:53.254045 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-72c0d1df-a281-419b-a41f-127ec3585c16 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:53.387240 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-72c0d1df-a281-419b-a41f-127ec3585c16 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:53.394757 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-72c0d1df-a281-419b-a41f-127ec3585c16 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1674 microversion: 2.1 time: 0.154596 Jul 19 20:54:53.395315 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 262/556] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:53 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:53.874829 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b884baa6-e50d-40eb-bbbe-9f6b19de4b18 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:53.875836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b884baa6-e50d-40eb-bbbe-9f6b19de4b18 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:53.886955 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b884baa6-e50d-40eb-bbbe-9f6b19de4b18 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:53.887410 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b884baa6-e50d-40eb-bbbe-9f6b19de4b18 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:53.888220 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b884baa6-e50d-40eb-bbbe-9f6b19de4b18 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:53.888659 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b884baa6-e50d-40eb-bbbe-9f6b19de4b18 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:54.058302 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b884baa6-e50d-40eb-bbbe-9f6b19de4b18 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:54.073257 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b884baa6-e50d-40eb-bbbe-9f6b19de4b18 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1682 microversion: 2.1 time: 0.202558 Jul 19 20:54:54.074771 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 295/557] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:53 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1682 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:54.413510 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-baeb8981-9e3f-4145-ba27-090bbfd103d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:54.414324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-baeb8981-9e3f-4145-ba27-090bbfd103d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:54.423005 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-baeb8981-9e3f-4145-ba27-090bbfd103d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:54.423600 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-baeb8981-9e3f-4145-ba27-090bbfd103d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:54.433436 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-baeb8981-9e3f-4145-ba27-090bbfd103d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:54.433436 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-baeb8981-9e3f-4145-ba27-090bbfd103d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:54.581579 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-4f9594d8-1997-4e34-bad1-c352fe7bd27d req-723de2e5-63d1-42e1-8678-ab15e839ceb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3a1c24-8f18-49bb-9bbf-711a808f4ea6", "name": "network-vif-deleted", "tag": "8c146d65-9129-430d-bf2e-1d764005f0fe"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:54.622008 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-4f9594d8-1997-4e34-bad1-c352fe7bd27d req-723de2e5-63d1-42e1-8678-ab15e839ceb1 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:54.622550 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-baeb8981-9e3f-4145-ba27-090bbfd103d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:54.622778 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-4f9594d8-1997-4e34-bad1-c352fe7bd27d req-723de2e5-63d1-42e1-8678-ab15e839ceb1 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:54.631549 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-baeb8981-9e3f-4145-ba27-090bbfd103d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1674 microversion: 2.1 time: 0.222148 Jul 19 20:54:54.632301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 263/558] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:54 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1674 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:54.658692 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-4f9594d8-1997-4e34-bad1-c352fe7bd27d req-723de2e5-63d1-42e1-8678-ab15e839ceb1 service nova] Creating event network-vif-deleted:8c146d65-9129-430d-bf2e-1d764005f0fe for instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 on hv-cinder-79987 Jul 19 20:54:54.665346 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-4f9594d8-1997-4e34-bad1-c352fe7bd27d req-723de2e5-63d1-42e1-8678-ab15e839ceb1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091135 Jul 19 20:54:54.666892 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 296/559] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:54:55.098138 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-3dad1d2d-8694-4e5e-a273-a0d45088aa84 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:55.099276 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-3dad1d2d-8694-4e5e-a273-a0d45088aa84 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:55.111637 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3dad1d2d-8694-4e5e-a273-a0d45088aa84 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.112495 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3dad1d2d-8694-4e5e-a273-a0d45088aa84 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:55.114020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3dad1d2d-8694-4e5e-a273-a0d45088aa84 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.115102 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3dad1d2d-8694-4e5e-a273-a0d45088aa84 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:55.177811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3dad1d2d-8694-4e5e-a273-a0d45088aa84 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.178357 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3dad1d2d-8694-4e5e-a273-a0d45088aa84 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:55.178860 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-3dad1d2d-8694-4e5e-a273-a0d45088aa84 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lazy-loading 'fault' on Instance uuid 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:54:55.241037 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3dad1d2d-8694-4e5e-a273-a0d45088aa84 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:55.250177 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:55.252991 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-3dad1d2d-8694-4e5e-a273-a0d45088aa84 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 200 len: 1331 microversion: 2.1 time: 0.162394 Jul 19 20:54:55.253840 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 264/560] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:55 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 1331 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:55.658610 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-083a7e77-604d-4ec3-97e4-ac6c6bfb7f5a tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:55.660696 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-083a7e77-604d-4ec3-97e4-ac6c6bfb7f5a tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:55.672623 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-083a7e77-604d-4ec3-97e4-ac6c6bfb7f5a tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.673198 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-083a7e77-604d-4ec3-97e4-ac6c6bfb7f5a tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:55.674342 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-083a7e77-604d-4ec3-97e4-ac6c6bfb7f5a tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.674541 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-083a7e77-604d-4ec3-97e4-ac6c6bfb7f5a tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:55.834841 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-083a7e77-604d-4ec3-97e4-ac6c6bfb7f5a tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:55.842977 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-083a7e77-604d-4ec3-97e4-ac6c6bfb7f5a tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1674 microversion: 2.1 time: 0.194281 Jul 19 20:54:55.843553 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 297/561] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:55 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:56.271617 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0503f39b-2a24-4efb-9c87-c211b61968a0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:56.272240 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0503f39b-2a24-4efb-9c87-c211b61968a0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:56.280378 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0503f39b-2a24-4efb-9c87-c211b61968a0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:56.280833 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0503f39b-2a24-4efb-9c87-c211b61968a0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:56.281651 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0503f39b-2a24-4efb-9c87-c211b61968a0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:56.283536 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0503f39b-2a24-4efb-9c87-c211b61968a0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:56.296605 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-0503f39b-2a24-4efb-9c87-c211b61968a0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0503f39b-2a24-4efb-9c87-c211b61968a0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 HTTP/1.1 Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:54:56.298359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:54:56.299899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:54:56.299899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:54:56.299899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:54:56.299899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:54:56.299899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:54:56.299899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:54:56.299899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:54:56.299899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:54:56.299899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:54:56.299899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:54:56.299899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:54:56.299899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '8a3a1c24-8f18-49bb-9bbf-711a808f4ea6'} Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:54:56.300713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:54:56.302171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:54:56.303379 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0503f39b-2a24-4efb-9c87-c211b61968a0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 404 to user: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:54:56.303379 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0503f39b-2a24-4efb-9c87-c211b61968a0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 404 len: 111 microversion: 2.1 time: 0.032419 Jul 19 20:54:56.303379 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 265/562] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:56 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:54:56.313210 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-25e72daf-fd84-42a2-9b77-21fab8b9098d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '.version_select at 0x7f25277f30d0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:56.336755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-25e72daf-fd84-42a2-9b77-21fab8b9098d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1321512039" status: 202 len: 0 microversion: 2.1 time: 0.030406 Jul 19 20:54:56.337351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 298/563] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jul 19 20:54:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1321512039 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:54:56.861211 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-bd8b4934-4609-43e1-9525-126f5099660e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:56.861992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-bd8b4934-4609-43e1-9525-126f5099660e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:56.868944 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bd8b4934-4609-43e1-9525-126f5099660e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:56.869570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bd8b4934-4609-43e1-9525-126f5099660e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:56.870394 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bd8b4934-4609-43e1-9525-126f5099660e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:56.870833 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bd8b4934-4609-43e1-9525-126f5099660e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:57.030921 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-bd8b4934-4609-43e1-9525-126f5099660e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:57.041595 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-bd8b4934-4609-43e1-9525-126f5099660e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1674 microversion: 2.1 time: 0.182485 Jul 19 20:54:57.041595 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 266/564] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:56 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:57.069606 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-1811d9e9-1645-481f-9039-ee0c5366de1c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: .version_select at 0x7f25277cc8b0>, body: {"keypair": {"name": "tempest-keypair-1205300838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQTd3wtwx6lCT4FOxKZFC8XHKiNgnIeuu9Cqt/UKpkcjVQPx0JvmoqI44Fh6zz7jo+A3egH3gmD4huN2gCnY6jj4g5V66kzqaYESDJA/kY6q9Gi3DnMKWiR1FOl+rYyeQ=="}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:57.088942 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-1811d9e9-1645-481f-9039-ee0c5366de1c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for project 5da6c42976154440bd0459beb12477f2. Resources: {'key_pairs'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:54:57.093749 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-1811d9e9-1645-481f-9039-ee0c5366de1c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for user af989ff6dc024ff19023e6f633915ec3 and project 5da6c42976154440bd0459beb12477f2. Resources: {'key_pairs'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:54:57.121039 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-1811d9e9-1645-481f-9039-ee0c5366de1c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056509 Jul 19 20:54:57.121598 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 299/565] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jul 19 20:54:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:54:58.059038 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-56f15bc7-e20d-4008-8d5e-356a70ea5589 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:58.059836 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-56f15bc7-e20d-4008-8d5e-356a70ea5589 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:58.067166 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-56f15bc7-e20d-4008-8d5e-356a70ea5589 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:58.067717 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-56f15bc7-e20d-4008-8d5e-356a70ea5589 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:58.068614 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-56f15bc7-e20d-4008-8d5e-356a70ea5589 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:58.069123 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-56f15bc7-e20d-4008-8d5e-356a70ea5589 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:58.245075 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-56f15bc7-e20d-4008-8d5e-356a70ea5589 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:58.260198 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-56f15bc7-e20d-4008-8d5e-356a70ea5589 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1674 microversion: 2.1 time: 0.205046 Jul 19 20:54:58.260410 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 267/566] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:58 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:58.634621 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1959822458", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4988720a-c392-40ae-8d35-c194234e1fb1"}], "security_groups": [{"name": "tempest-securitygroup--740306389"}], "key_name": "tempest-keypair-1205300838", "user_data": "}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:58.763249 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.network.neutron [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] validate_networks() for [('4988720a-c392-40ae-8d35-c194234e1fb1', None, None, None, None, None)] {{(pid=129866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:54:59.249324 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Flavor limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:54:59.249840 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Image limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:54:59.250498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Flavor pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:54:59.251356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Image pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:54:59.251468 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:54:59.261100 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.261582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.262686 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.262853 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.277969 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4b04d29b-0c81-4984-b203-c6a5abc4e789 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:59.278567 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4b04d29b-0c81-4984-b203-c6a5abc4e789 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:59.284340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for project 5da6c42976154440bd0459beb12477f2. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:54:59.285467 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4b04d29b-0c81-4984-b203-c6a5abc4e789 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.285922 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4b04d29b-0c81-4984-b203-c6a5abc4e789 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.286682 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4b04d29b-0c81-4984-b203-c6a5abc4e789 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.287303 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4b04d29b-0c81-4984-b203-c6a5abc4e789 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.290899 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for user af989ff6dc024ff19023e6f633915ec3 and project 5da6c42976154440bd0459beb12477f2. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:54:59.307109 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Going to run 1 instances... {{(pid=129866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:54:59.309650 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:54:59.375174 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-018b0d0b-7d8f-4919-9456-2ff2a011c776 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.744656 Jul 19 20:54:59.375842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 300/567] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:54:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:54:59.488042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4b04d29b-0c81-4984-b203-c6a5abc4e789 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:59.496301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4b04d29b-0c81-4984-b203-c6a5abc4e789 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1674 microversion: 2.1 time: 0.222528 Jul 19 20:54:59.497600 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 268/568] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:59 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1674 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:59.507321 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-97070853-a413-4bc1-8704-8a3c0e40f303 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:59.508191 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-97070853-a413-4bc1-8704-8a3c0e40f303 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:59.541781 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ef65f4ef-f741-4abe-a464-d769cb52aee7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:59.542286 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ef65f4ef-f741-4abe-a464-d769cb52aee7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:59.549986 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ef65f4ef-f741-4abe-a464-d769cb52aee7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.550562 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ef65f4ef-f741-4abe-a464-d769cb52aee7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.551232 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ef65f4ef-f741-4abe-a464-d769cb52aee7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.551675 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ef65f4ef-f741-4abe-a464-d769cb52aee7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.570471 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-97070853-a413-4bc1-8704-8a3c0e40f303 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:59.577903 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-97070853-a413-4bc1-8704-8a3c0e40f303 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1242 microversion: 2.1 time: 0.078911 Jul 19 20:54:59.578496 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 269/569] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:59 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:59.587345 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ef65f4ef-f741-4abe-a464-d769cb52aee7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-volume_attachments/6ab339aa-5489-471a-afce-9e8f8e7477a1" status: 200 len: 194 microversion: 2.20 time: 0.204201 Jul 19 20:54:59.587962 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 301/570] 10.222.0.70 () {60 vars in 1453 bytes} [Tue Jul 19 20:54:59 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-volume_attachments/6ab339aa-5489-471a-afce-9e8f8e7477a1 => generated 194 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:54:59.660574 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-011ed6ed-9c97-4724-a96e-ded4e7348929 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:59.661085 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-011ed6ed-9c97-4724-a96e-ded4e7348929 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:59.668456 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-011ed6ed-9c97-4724-a96e-ded4e7348929 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.668933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-011ed6ed-9c97-4724-a96e-ded4e7348929 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.669933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-011ed6ed-9c97-4724-a96e-ded4e7348929 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.670979 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-011ed6ed-9c97-4724-a96e-ded4e7348929 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.776973 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-011ed6ed-9c97-4724-a96e-ded4e7348929 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lazy-loading 'services' on Instance uuid 9e43f46e-319f-4ec4-8d5a-0e95995dc370 {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:54:59.857938 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-011ed6ed-9c97-4724-a96e-ded4e7348929 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-volume_attachments/6ab339aa-5489-471a-afce-9e8f8e7477a1" status: 202 len: 0 microversion: 2.20 time: 0.201601 Jul 19 20:54:59.858924 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 270/571] 10.222.0.70 () {60 vars in 1456 bytes} [Tue Jul 19 20:54:59 2022] DELETE /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-volume_attachments/6ab339aa-5489-471a-afce-9e8f8e7477a1 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:54:59.870822 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-71b0ec9c-8155-4aab-b6eb-5f5d10675378 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:59.872507 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-71b0ec9c-8155-4aab-b6eb-5f5d10675378 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:59.883495 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71b0ec9c-8155-4aab-b6eb-5f5d10675378 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.884173 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71b0ec9c-8155-4aab-b6eb-5f5d10675378 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.885134 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71b0ec9c-8155-4aab-b6eb-5f5d10675378 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.885692 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71b0ec9c-8155-4aab-b6eb-5f5d10675378 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.921196 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:59.927422 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-71b0ec9c-8155-4aab-b6eb-5f5d10675378 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062872 Jul 19 20:54:59.928155 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 302/572] 10.222.0.70 () {60 vars in 1342 bytes} [Tue Jul 19 20:54:59 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 20:55:00.524537 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-893d40dc-da2a-4d59-8abd-ac516967a3e3 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:00.527107 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-893d40dc-da2a-4d59-8abd-ac516967a3e3 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:00.539244 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-893d40dc-da2a-4d59-8abd-ac516967a3e3 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.539987 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-893d40dc-da2a-4d59-8abd-ac516967a3e3 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.541331 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-893d40dc-da2a-4d59-8abd-ac516967a3e3 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.542546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-893d40dc-da2a-4d59-8abd-ac516967a3e3 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.596606 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e0816d5d-e67c-4c87-a8ce-0536ea47275c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:00.597451 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e0816d5d-e67c-4c87-a8ce-0536ea47275c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:00.608686 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e0816d5d-e67c-4c87-a8ce-0536ea47275c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.609201 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e0816d5d-e67c-4c87-a8ce-0536ea47275c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.610274 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e0816d5d-e67c-4c87-a8ce-0536ea47275c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.610751 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e0816d5d-e67c-4c87-a8ce-0536ea47275c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.695935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e0816d5d-e67c-4c87-a8ce-0536ea47275c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:00.706761 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e0816d5d-e67c-4c87-a8ce-0536ea47275c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1294 microversion: 2.1 time: 0.113921 Jul 19 20:55:00.707807 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 303/573] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:00 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1294 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:00.740070 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-893d40dc-da2a-4d59-8abd-ac516967a3e3 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:00.748952 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-893d40dc-da2a-4d59-8abd-ac516967a3e3 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1651 microversion: 2.1 time: 0.234263 Jul 19 20:55:00.749719 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 271/574] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:00 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1651 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:00.770370 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c4756b8d-cad9-4924-9922-fa4ae8157415 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:00.781664 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c4756b8d-cad9-4924-9922-fa4ae8157415 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.782356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c4756b8d-cad9-4924-9922-fa4ae8157415 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.828342 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c4756b8d-cad9-4924-9922-fa4ae8157415 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Going to try to start instance {{(pid=129866) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 20:55:00.911269 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c4756b8d-cad9-4924-9922-fa4ae8157415 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "POST /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/action" status: 202 len: 0 microversion: 2.1 time: 0.147687 Jul 19 20:55:00.911269 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 304/575] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 20:55:00 2022] POST /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:55:00.920749 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-58443316-dd79-490e-a5ba-477d5871c527 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:00.921765 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-58443316-dd79-490e-a5ba-477d5871c527 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:00.930308 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-58443316-dd79-490e-a5ba-477d5871c527 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.930835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-58443316-dd79-490e-a5ba-477d5871c527 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.931705 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-58443316-dd79-490e-a5ba-477d5871c527 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.932151 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-58443316-dd79-490e-a5ba-477d5871c527 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.943025 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-392f6fc8-3daf-4cda-9a07-5fae342d717b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:00.944989 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-392f6fc8-3daf-4cda-9a07-5fae342d717b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:00.952170 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-392f6fc8-3daf-4cda-9a07-5fae342d717b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.952623 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-392f6fc8-3daf-4cda-9a07-5fae342d717b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.953458 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-392f6fc8-3daf-4cda-9a07-5fae342d717b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.953901 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-392f6fc8-3daf-4cda-9a07-5fae342d717b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.990979 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-392f6fc8-3daf-4cda-9a07-5fae342d717b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053809 Jul 19 20:55:00.991873 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 305/576] 10.222.0.70 () {60 vars in 1342 bytes} [Tue Jul 19 20:55:00 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 20:55:01.160641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-58443316-dd79-490e-a5ba-477d5871c527 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:01.176437 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-58443316-dd79-490e-a5ba-477d5871c527 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1660 microversion: 2.1 time: 0.259768 Jul 19 20:55:01.195566 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 272/577] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:00 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1660 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:01.727249 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d6bcde06-4968-45a7-81ce-9f8dd784c62e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:01.728289 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d6bcde06-4968-45a7-81ce-9f8dd784c62e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:01.736660 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d6bcde06-4968-45a7-81ce-9f8dd784c62e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:01.737583 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d6bcde06-4968-45a7-81ce-9f8dd784c62e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:01.738838 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d6bcde06-4968-45a7-81ce-9f8dd784c62e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:01.739485 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d6bcde06-4968-45a7-81ce-9f8dd784c62e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:01.834738 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d6bcde06-4968-45a7-81ce-9f8dd784c62e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:01.845915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d6bcde06-4968-45a7-81ce-9f8dd784c62e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1300 microversion: 2.1 time: 0.123011 Jul 19 20:55:01.847316 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 306/578] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:01 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:02.008768 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9f853564-bc0c-46db-bcf8-35d104601f65 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:02.010450 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9f853564-bc0c-46db-bcf8-35d104601f65 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:02.019208 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f853564-bc0c-46db-bcf8-35d104601f65 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:02.019669 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f853564-bc0c-46db-bcf8-35d104601f65 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:02.020482 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f853564-bc0c-46db-bcf8-35d104601f65 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:02.020925 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f853564-bc0c-46db-bcf8-35d104601f65 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:02.057088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9f853564-bc0c-46db-bcf8-35d104601f65 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054808 Jul 19 20:55:02.057811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 273/579] 10.222.0.70 () {60 vars in 1342 bytes} [Tue Jul 19 20:55:02 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:02.169960 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-84fda054-9f63-4f83-8ef4-152148ae2b26 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:02.170601 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-84fda054-9f63-4f83-8ef4-152148ae2b26 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:02.178864 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-84fda054-9f63-4f83-8ef4-152148ae2b26 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:02.179338 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-84fda054-9f63-4f83-8ef4-152148ae2b26 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:02.180128 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-84fda054-9f63-4f83-8ef4-152148ae2b26 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:02.180559 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-84fda054-9f63-4f83-8ef4-152148ae2b26 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:02.209606 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0218eae0-bc95-4325-8b1a-e2d009767710 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:02.210940 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0218eae0-bc95-4325-8b1a-e2d009767710 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:02.218372 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-84fda054-9f63-4f83-8ef4-152148ae2b26 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Going to try to terminate instance {{(pid=129866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:55:02.221971 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0218eae0-bc95-4325-8b1a-e2d009767710 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:02.222570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0218eae0-bc95-4325-8b1a-e2d009767710 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:02.223452 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0218eae0-bc95-4325-8b1a-e2d009767710 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:02.224006 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0218eae0-bc95-4325-8b1a-e2d009767710 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:02.393716 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-84fda054-9f63-4f83-8ef4-152148ae2b26 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 204 len: 0 microversion: 2.20 time: 0.227279 Jul 19 20:55:02.394590 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 307/580] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jul 19 20:55:02 2022] DELETE /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:55:02.405657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dbfdc021-e523-4094-adaa-5d40c7eb5c41 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:02.406532 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-dbfdc021-e523-4094-adaa-5d40c7eb5c41 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:02.414133 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dbfdc021-e523-4094-adaa-5d40c7eb5c41 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:02.414839 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dbfdc021-e523-4094-adaa-5d40c7eb5c41 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:02.415648 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dbfdc021-e523-4094-adaa-5d40c7eb5c41 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:02.416091 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dbfdc021-e523-4094-adaa-5d40c7eb5c41 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:02.447299 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0218eae0-bc95-4325-8b1a-e2d009767710 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:02.458618 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0218eae0-bc95-4325-8b1a-e2d009767710 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1660 microversion: 2.1 time: 0.258220 Jul 19 20:55:02.459630 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 274/581] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:02 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1660 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:02.584874 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dbfdc021-e523-4094-adaa-5d40c7eb5c41 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:02.595675 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dbfdc021-e523-4094-adaa-5d40c7eb5c41 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:02.597646 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dbfdc021-e523-4094-adaa-5d40c7eb5c41 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:02.598982 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dbfdc021-e523-4094-adaa-5d40c7eb5c41 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.199404 Jul 19 20:55:02.608770 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 308/582] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:02 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:02.864576 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f2204fd5-5e71-444f-9c74-37d4992e9ddf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:02.865279 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f2204fd5-5e71-444f-9c74-37d4992e9ddf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:02.872014 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f2204fd5-5e71-444f-9c74-37d4992e9ddf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:02.872525 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f2204fd5-5e71-444f-9c74-37d4992e9ddf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:02.873941 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f2204fd5-5e71-444f-9c74-37d4992e9ddf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:02.874530 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f2204fd5-5e71-444f-9c74-37d4992e9ddf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:03.019709 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f2204fd5-5e71-444f-9c74-37d4992e9ddf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:03.028409 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f2204fd5-5e71-444f-9c74-37d4992e9ddf tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1367 microversion: 2.1 time: 0.167609 Jul 19 20:55:03.028993 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 275/583] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:02 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:03.476630 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8b35699e-c1ac-4926-b0ee-2a15de809a7f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:03.477669 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8b35699e-c1ac-4926-b0ee-2a15de809a7f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:03.485353 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8b35699e-c1ac-4926-b0ee-2a15de809a7f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:03.485913 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8b35699e-c1ac-4926-b0ee-2a15de809a7f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:03.486805 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8b35699e-c1ac-4926-b0ee-2a15de809a7f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:03.487344 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8b35699e-c1ac-4926-b0ee-2a15de809a7f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:03.619306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a0fe2339-e601-4fd9-8e84-4302fe4cb7e7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:03.620017 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a0fe2339-e601-4fd9-8e84-4302fe4cb7e7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:03.626987 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a0fe2339-e601-4fd9-8e84-4302fe4cb7e7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:03.627535 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a0fe2339-e601-4fd9-8e84-4302fe4cb7e7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:03.628387 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a0fe2339-e601-4fd9-8e84-4302fe4cb7e7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:03.628896 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a0fe2339-e601-4fd9-8e84-4302fe4cb7e7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:03.633069 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-8b35699e-c1ac-4926-b0ee-2a15de809a7f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:03.650932 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8b35699e-c1ac-4926-b0ee-2a15de809a7f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1660 microversion: 2.1 time: 0.177839 Jul 19 20:55:03.653990 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 309/584] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:03 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1660 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:03.800745 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a0fe2339-e601-4fd9-8e84-4302fe4cb7e7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:03.809565 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a0fe2339-e601-4fd9-8e84-4302fe4cb7e7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:03.811738 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a0fe2339-e601-4fd9-8e84-4302fe4cb7e7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:03.812962 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a0fe2339-e601-4fd9-8e84-4302fe4cb7e7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.197737 Jul 19 20:55:03.813550 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 276/585] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:03 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:55:04.046172 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-66d0b69f-7afc-4f2d-8b05-aca32ffeb555 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:04.046727 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-66d0b69f-7afc-4f2d-8b05-aca32ffeb555 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:04.053426 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-66d0b69f-7afc-4f2d-8b05-aca32ffeb555 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:04.053888 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-66d0b69f-7afc-4f2d-8b05-aca32ffeb555 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:04.054820 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-66d0b69f-7afc-4f2d-8b05-aca32ffeb555 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:04.055348 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-66d0b69f-7afc-4f2d-8b05-aca32ffeb555 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:04.200394 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-66d0b69f-7afc-4f2d-8b05-aca32ffeb555 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:04.208546 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-66d0b69f-7afc-4f2d-8b05-aca32ffeb555 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1367 microversion: 2.1 time: 0.166421 Jul 19 20:55:04.209395 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 310/586] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:04 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:04.636731 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-34542b25-dfaa-4722-8f9a-ffec7862bd91 req-c1b18b6a-3bed-4045-83b5-d9024cdcbe9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0154001-450f-477f-a952-a769ea371c70", "tag": "6dfd4f22-87be-433f-bfa4-66f03eca4dd9"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:04.650132 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-34542b25-dfaa-4722-8f9a-ffec7862bd91 req-c1b18b6a-3bed-4045-83b5-d9024cdcbe9b service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:04.650480 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-34542b25-dfaa-4722-8f9a-ffec7862bd91 req-c1b18b6a-3bed-4045-83b5-d9024cdcbe9b service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:04.666264 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-34542b25-dfaa-4722-8f9a-ffec7862bd91 req-c1b18b6a-3bed-4045-83b5-d9024cdcbe9b service nova] Creating event network-changed:6dfd4f22-87be-433f-bfa4-66f03eca4dd9 for instance a0154001-450f-477f-a952-a769ea371c70 on hv-cinder-79987 Jul 19 20:55:04.672018 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-34542b25-dfaa-4722-8f9a-ffec7862bd91 req-c1b18b6a-3bed-4045-83b5-d9024cdcbe9b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049608 Jul 19 20:55:04.673123 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0b7f86bf-7942-4d09-9b13-e5fb8a1edf7b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:04.673839 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 277/587] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:04.683155 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0b7f86bf-7942-4d09-9b13-e5fb8a1edf7b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:04.692034 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0b7f86bf-7942-4d09-9b13-e5fb8a1edf7b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:04.692845 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0b7f86bf-7942-4d09-9b13-e5fb8a1edf7b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:04.693798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0b7f86bf-7942-4d09-9b13-e5fb8a1edf7b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:04.694467 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0b7f86bf-7942-4d09-9b13-e5fb8a1edf7b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:04.832915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a1f91861-9f2b-4802-bcd3-33d8311b90dc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:04.833803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a1f91861-9f2b-4802-bcd3-33d8311b90dc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:04.842455 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a1f91861-9f2b-4802-bcd3-33d8311b90dc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:04.843350 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a1f91861-9f2b-4802-bcd3-33d8311b90dc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:04.844832 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a1f91861-9f2b-4802-bcd3-33d8311b90dc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:04.845816 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a1f91861-9f2b-4802-bcd3-33d8311b90dc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:04.917872 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0b7f86bf-7942-4d09-9b13-e5fb8a1edf7b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:04.929561 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0b7f86bf-7942-4d09-9b13-e5fb8a1edf7b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1664 microversion: 2.1 time: 0.260671 Jul 19 20:55:04.930494 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 311/588] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:04 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1664 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:05.065715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a1f91861-9f2b-4802-bcd3-33d8311b90dc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:05.079605 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a1f91861-9f2b-4802-bcd3-33d8311b90dc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:05.082699 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a1f91861-9f2b-4802-bcd3-33d8311b90dc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:05.084789 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a1f91861-9f2b-4802-bcd3-33d8311b90dc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.256115 Jul 19 20:55:05.085865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 278/589] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:04 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:55:05.226529 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-048a6a57-7e6e-4e97-a372-bc67d2055d33 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:05.227131 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-048a6a57-7e6e-4e97-a372-bc67d2055d33 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:05.234017 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-048a6a57-7e6e-4e97-a372-bc67d2055d33 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:05.234724 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-048a6a57-7e6e-4e97-a372-bc67d2055d33 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:05.235720 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-048a6a57-7e6e-4e97-a372-bc67d2055d33 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:05.236166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-048a6a57-7e6e-4e97-a372-bc67d2055d33 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:05.395138 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-048a6a57-7e6e-4e97-a372-bc67d2055d33 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:05.405184 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-048a6a57-7e6e-4e97-a372-bc67d2055d33 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1367 microversion: 2.1 time: 0.182309 Jul 19 20:55:05.406463 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 312/590] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:05 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:06.116598 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-6e7e092a-d7ce-447f-9770-15cbaa48ba0c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:06.117242 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-6e7e092a-d7ce-447f-9770-15cbaa48ba0c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:06.124515 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6e7e092a-d7ce-447f-9770-15cbaa48ba0c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.124975 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6e7e092a-d7ce-447f-9770-15cbaa48ba0c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:06.125887 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6e7e092a-d7ce-447f-9770-15cbaa48ba0c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.126332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6e7e092a-d7ce-447f-9770-15cbaa48ba0c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:06.298684 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6e7e092a-d7ce-447f-9770-15cbaa48ba0c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:06.310051 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6e7e092a-d7ce-447f-9770-15cbaa48ba0c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:06.311703 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6e7e092a-d7ce-447f-9770-15cbaa48ba0c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:06.313163 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-6e7e092a-d7ce-447f-9770-15cbaa48ba0c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1720 microversion: 2.20 time: 0.204277 Jul 19 20:55:06.313827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 279/591] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:06 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:06.428292 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c02bf6de-1d84-40ed-bd8e-f32e926690ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:06.428919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c02bf6de-1d84-40ed-bd8e-f32e926690ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:06.435594 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c02bf6de-1d84-40ed-bd8e-f32e926690ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.436065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c02bf6de-1d84-40ed-bd8e-f32e926690ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:06.436826 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c02bf6de-1d84-40ed-bd8e-f32e926690ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.437257 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c02bf6de-1d84-40ed-bd8e-f32e926690ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:06.572893 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c02bf6de-1d84-40ed-bd8e-f32e926690ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:06.581421 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c02bf6de-1d84-40ed-bd8e-f32e926690ce tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1367 microversion: 2.1 time: 0.156836 Jul 19 20:55:06.582103 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 313/592] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:06 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:06.795578 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-2b4f5999-3133-46d2-9db0-f827df4b1373 req-910bb95e-117e-4d0d-8451-e79ba9e8c46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e43f46e-319f-4ec4-8d5a-0e95995dc370", "name": "network-vif-deleted", "tag": "8f0876b6-27aa-4999-81eb-a3e576f37753"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:06.820997 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-2b4f5999-3133-46d2-9db0-f827df4b1373 req-910bb95e-117e-4d0d-8451-e79ba9e8c46c service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.822546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-2b4f5999-3133-46d2-9db0-f827df4b1373 req-910bb95e-117e-4d0d-8451-e79ba9e8c46c service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:06.846028 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-2b4f5999-3133-46d2-9db0-f827df4b1373 req-910bb95e-117e-4d0d-8451-e79ba9e8c46c service nova] Creating event network-vif-deleted:8f0876b6-27aa-4999-81eb-a3e576f37753 for instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 on hv-cinder-79987 Jul 19 20:55:06.855870 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-2b4f5999-3133-46d2-9db0-f827df4b1373 req-910bb95e-117e-4d0d-8451-e79ba9e8c46c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064782 Jul 19 20:55:06.856770 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 280/593] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:55:07.334547 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9fe821fc-da40-4f20-bb91-775aa0a124b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:07.335730 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-9fe821fc-da40-4f20-bb91-775aa0a124b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:07.340793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:07.347791 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fe821fc-da40-4f20-bb91-775aa0a124b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:07.348590 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fe821fc-da40-4f20-bb91-775aa0a124b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:07.349993 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fe821fc-da40-4f20-bb91-775aa0a124b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:07.350560 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fe821fc-da40-4f20-bb91-775aa0a124b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:07.446511 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9fe821fc-da40-4f20-bb91-775aa0a124b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:07.459224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9fe821fc-da40-4f20-bb91-775aa0a124b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:07.460816 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9fe821fc-da40-4f20-bb91-775aa0a124b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:07.462068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9fe821fc-da40-4f20-bb91-775aa0a124b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1654 microversion: 2.20 time: 0.131920 Jul 19 20:55:07.462631 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 314/594] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:07 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1654 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:07.600723 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fcd6e6c4-1bac-409a-917c-49a4c75b794b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:07.601811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-fcd6e6c4-1bac-409a-917c-49a4c75b794b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:07.612720 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fcd6e6c4-1bac-409a-917c-49a4c75b794b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:07.615573 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fcd6e6c4-1bac-409a-917c-49a4c75b794b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:07.619628 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fcd6e6c4-1bac-409a-917c-49a4c75b794b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:07.620294 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fcd6e6c4-1bac-409a-917c-49a4c75b794b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:07.809407 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-fcd6e6c4-1bac-409a-917c-49a4c75b794b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:07.822824 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fcd6e6c4-1bac-409a-917c-49a4c75b794b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1367 microversion: 2.1 time: 0.226765 Jul 19 20:55:07.823600 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 281/595] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:07 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:08.495243 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7ad3179f-f8b8-4d2b-bbf5-6bd13821361d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:08.496115 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-7ad3179f-f8b8-4d2b-bbf5-6bd13821361d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:08.510657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7ad3179f-f8b8-4d2b-bbf5-6bd13821361d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:08.511110 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7ad3179f-f8b8-4d2b-bbf5-6bd13821361d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:08.511904 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7ad3179f-f8b8-4d2b-bbf5-6bd13821361d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:08.512436 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7ad3179f-f8b8-4d2b-bbf5-6bd13821361d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:08.583668 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-7ad3179f-f8b8-4d2b-bbf5-6bd13821361d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:08.593688 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-7ad3179f-f8b8-4d2b-bbf5-6bd13821361d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:08.595334 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-7ad3179f-f8b8-4d2b-bbf5-6bd13821361d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:08.596409 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-7ad3179f-f8b8-4d2b-bbf5-6bd13821361d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 200 len: 1654 microversion: 2.20 time: 0.106260 Jul 19 20:55:08.597034 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 315/596] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:08 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 1654 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:08.843171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-605900d4-9857-49b3-9cae-35b79872bf0b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:08.843805 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-605900d4-9857-49b3-9cae-35b79872bf0b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:08.850795 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-605900d4-9857-49b3-9cae-35b79872bf0b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:08.851507 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-605900d4-9857-49b3-9cae-35b79872bf0b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:08.852295 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-605900d4-9857-49b3-9cae-35b79872bf0b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:08.852737 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-605900d4-9857-49b3-9cae-35b79872bf0b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:09.008493 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-605900d4-9857-49b3-9cae-35b79872bf0b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:09.017338 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-605900d4-9857-49b3-9cae-35b79872bf0b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1367 microversion: 2.1 time: 0.177736 Jul 19 20:55:09.017338 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 282/597] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:08 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:09.623405 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5362618a-4b08-4688-8c3c-5b2ea9626cbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:09.628769 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5362618a-4b08-4688-8c3c-5b2ea9626cbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:09.631363 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:09.632631 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=10 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:09.642947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5362618a-4b08-4688-8c3c-5b2ea9626cbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:09.643732 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5362618a-4b08-4688-8c3c-5b2ea9626cbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:09.645143 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5362618a-4b08-4688-8c3c-5b2ea9626cbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:09.646168 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5362618a-4b08-4688-8c3c-5b2ea9626cbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:09.675701 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-5362618a-4b08-4688-8c3c-5b2ea9626cbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] HTTP exception thrown: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5362618a-4b08-4688-8c3c-5b2ea9626cbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Request method failure captured: Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 HTTP/1.1 Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjN7BWqewYsqIeSXb4fvLrtHf8kRLC0deD9-bnL97GxmNKgEemjEsKNG-S7Yi-yNEGsTW7LBTlS8rO_XOE_vZrVGpSpcllwmTjajNtSOSZ95aKNbR7GPSMVAmxZB9Z__TyerHik-5lqHwtRG4tqO6yGzIRZJp4KnQUkjhJHpLXBE8U Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 8298856e2d28408296cc7e4deca84846 Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:55:09.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:55:09.681340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8298856e2d28408296cc7e4deca84846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8298856e2d28408296cc7e4deca84846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8298856e2d28408296cc7e4deca84846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8298856e2d28408296cc7e4deca84846", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:55:09.681340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:55:09.681340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 8298856e2d28408296cc7e4deca84846 Jul 19 20:55:09.681340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:55:09.681340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-AttachVolumeShelveTestJSON-1158674853-project Jul 19 20:55:09.681340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:55:09.681340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:55:09.681340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: 31790576f8734f75adbbd8e9c0d61721 Jul 19 20:55:09.681340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1158674853-project Jul 19 20:55:09.681340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:55:09.681340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:55:09.681340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '9e43f46e-319f-4ec4-8d5a-0e95995dc370'} Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:55:09.683094 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:55:09.685856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:09.688600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5362618a-4b08-4688-8c3c-5b2ea9626cbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Returning 404 to user: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:55:09.688600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5362618a-4b08-4688-8c3c-5b2ea9626cbb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 404 len: 111 microversion: 2.20 time: 0.067776 Jul 19 20:55:09.688600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 316/598] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:09 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:55:09.691817 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7e778d4c-4009-4fc6-b773-c1449f7c80b6 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '.version_select at 0x7f2527f775e0>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:09.695397 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:09.729835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7e778d4c-4009-4fc6-b773-c1449f7c80b6 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-516235679" status: 204 len: 0 microversion: 2.20 time: 0.042090 Jul 19 20:55:09.730413 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 283/599] 10.222.0.70 () {60 vars in 1258 bytes} [Tue Jul 19 20:55:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-516235679 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 20:55:10.036280 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ccd86731-9352-4d28-b2b6-7d382eb5d7d9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:10.038130 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ccd86731-9352-4d28-b2b6-7d382eb5d7d9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:10.046487 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ccd86731-9352-4d28-b2b6-7d382eb5d7d9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:10.047085 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ccd86731-9352-4d28-b2b6-7d382eb5d7d9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:10.048101 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ccd86731-9352-4d28-b2b6-7d382eb5d7d9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:10.048655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ccd86731-9352-4d28-b2b6-7d382eb5d7d9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:10.084927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:10.360971 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ccd86731-9352-4d28-b2b6-7d382eb5d7d9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:10.375140 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ccd86731-9352-4d28-b2b6-7d382eb5d7d9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1367 microversion: 2.1 time: 0.343832 Jul 19 20:55:10.391019 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 317/600] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:10 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:10.709975 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e52452eb-1b5d-4310-828e-68f926da0b1f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Action: 'create', calling method: .version_select at 0x7f2527f07700>, body: {"keypair": {"name": "tempest-keypair-1376639542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGV5YAKcgGzvGsHnFT5S9Dc8oZ5oYh/YwdpFcAPUpOB6tc15Wjc6eA7Xnb7kqBXJ9tENbnGE17WM0zCkVwEeo/QuTRURZiDJGz38Jh1Y8hd+Tk4lh7sNI57qyVoMRvpqxg=="}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:10.727054 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-e52452eb-1b5d-4310-828e-68f926da0b1f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Getting quotas for project 8298856e2d28408296cc7e4deca84846. Resources: {'key_pairs'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:55:10.731493 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-e52452eb-1b5d-4310-828e-68f926da0b1f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Getting quotas for user 31790576f8734f75adbbd8e9c0d61721 and project 8298856e2d28408296cc7e4deca84846. Resources: {'key_pairs'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:55:10.758099 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e52452eb-1b5d-4310-828e-68f926da0b1f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053081 Jul 19 20:55:10.758938 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 284/601] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jul 19 20:55:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 20:55:11.403110 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d840cab8-322d-4a9d-97d7-d16ebf34c8c9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:11.404189 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d840cab8-322d-4a9d-97d7-d16ebf34c8c9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:11.412773 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d840cab8-322d-4a9d-97d7-d16ebf34c8c9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:11.413391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d840cab8-322d-4a9d-97d7-d16ebf34c8c9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:11.414411 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d840cab8-322d-4a9d-97d7-d16ebf34c8c9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:11.415090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d840cab8-322d-4a9d-97d7-d16ebf34c8c9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:11.647782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d840cab8-322d-4a9d-97d7-d16ebf34c8c9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:11.661932 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d840cab8-322d-4a9d-97d7-d16ebf34c8c9 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1367 microversion: 2.1 time: 0.263236 Jul 19 20:55:11.662224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 318/602] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:11 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:12.514368 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-62ca958a-5af3-421e-aa40-b4215571004f req-aa7c8de2-ea6d-4f89-8903-4a75a9a53f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0154001-450f-477f-a952-a769ea371c70", "name": "network-vif-plugged", "status": "completed", "tag": "6dfd4f22-87be-433f-bfa4-66f03eca4dd9"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:12.521554 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:12.534142 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-62ca958a-5af3-421e-aa40-b4215571004f req-aa7c8de2-ea6d-4f89-8903-4a75a9a53f70 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:12.535108 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-62ca958a-5af3-421e-aa40-b4215571004f req-aa7c8de2-ea6d-4f89-8903-4a75a9a53f70 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:12.561106 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-62ca958a-5af3-421e-aa40-b4215571004f req-aa7c8de2-ea6d-4f89-8903-4a75a9a53f70 service nova] Creating event network-vif-plugged:6dfd4f22-87be-433f-bfa4-66f03eca4dd9 for instance a0154001-450f-477f-a952-a769ea371c70 on hv-cinder-79987 Jul 19 20:55:12.571857 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-62ca958a-5af3-421e-aa40-b4215571004f req-aa7c8de2-ea6d-4f89-8903-4a75a9a53f70 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139944 Jul 19 20:55:12.573312 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 285/603] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:12.687969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ce953a82-21b4-4527-ac2b-a140f2cadf45 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:12.688803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ce953a82-21b4-4527-ac2b-a140f2cadf45 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:12.696574 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ce953a82-21b4-4527-ac2b-a140f2cadf45 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:12.697029 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ce953a82-21b4-4527-ac2b-a140f2cadf45 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:12.697868 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ce953a82-21b4-4527-ac2b-a140f2cadf45 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:12.698315 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ce953a82-21b4-4527-ac2b-a140f2cadf45 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:12.900136 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ce953a82-21b4-4527-ac2b-a140f2cadf45 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:12.916990 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ce953a82-21b4-4527-ac2b-a140f2cadf45 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1367 microversion: 2.1 time: 0.233193 Jul 19 20:55:12.919209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 319/604] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:12 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:12.964688 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1895223107", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30fadedb-1330-4e74-bc15-7d138c37f8ec"}], "security_groups": [{"name": "tempest-securitygroup--1475246159"}], "key_name": "tempest-keypair-1376639542", "user_data": "}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:13.124589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.network.neutron [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] validate_networks() for [('30fadedb-1330-4e74-bc15-7d138c37f8ec', None, None, None, None, None)] {{(pid=129867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:55:13.670482 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Flavor limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:55:13.671149 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Image limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:55:13.671467 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Flavor pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:55:13.671974 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Image pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:55:13.672397 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:55:13.682990 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:13.683443 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:13.684262 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:13.684700 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:13.706746 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Getting quotas for project 8298856e2d28408296cc7e4deca84846. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:55:13.712051 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Getting quotas for user 31790576f8734f75adbbd8e9c0d61721 and project 8298856e2d28408296cc7e4deca84846. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:55:13.729012 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Going to run 1 instances... {{(pid=129867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:55:13.731494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:55:13.790922 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-dd434c7a-59d4-40e2-a056-29bddf22dcb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.834565 Jul 19 20:55:13.791599 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 286/605] 10.222.0.70 () {62 vars in 1187 bytes} [Tue Jul 19 20:55:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 20:55:13.805434 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-54fae56e-7ec5-4c67-ae1c-44d33d138e58 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:13.806299 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-54fae56e-7ec5-4c67-ae1c-44d33d138e58 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:13.869352 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-54fae56e-7ec5-4c67-ae1c-44d33d138e58 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:13.877405 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-54fae56e-7ec5-4c67-ae1c-44d33d138e58 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:13.879041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-54fae56e-7ec5-4c67-ae1c-44d33d138e58 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:13.880323 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-54fae56e-7ec5-4c67-ae1c-44d33d138e58 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1282 microversion: 2.20 time: 0.079027 Jul 19 20:55:13.880902 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 320/606] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:13 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:13.940947 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2974ca25-5ba8-480c-891d-b4cdeba1c99f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:13.942028 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2974ca25-5ba8-480c-891d-b4cdeba1c99f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:13.954809 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2974ca25-5ba8-480c-891d-b4cdeba1c99f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:13.955429 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2974ca25-5ba8-480c-891d-b4cdeba1c99f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:13.956486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2974ca25-5ba8-480c-891d-b4cdeba1c99f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:13.957071 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2974ca25-5ba8-480c-891d-b4cdeba1c99f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:13.962927 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:14.197388 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2974ca25-5ba8-480c-891d-b4cdeba1c99f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:14.204747 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e2e5490e-f2cc-4c1f-b1c2-cb0d0fe781fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:14.205194 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e2e5490e-f2cc-4c1f-b1c2-cb0d0fe781fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:14.209090 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2974ca25-5ba8-480c-891d-b4cdeba1c99f tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1367 microversion: 2.1 time: 0.276370 Jul 19 20:55:14.210445 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 287/607] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:13 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:14.219479 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2e5490e-f2cc-4c1f-b1c2-cb0d0fe781fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:14.220748 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2e5490e-f2cc-4c1f-b1c2-cb0d0fe781fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:14.221854 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2e5490e-f2cc-4c1f-b1c2-cb0d0fe781fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:14.222476 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2e5490e-f2cc-4c1f-b1c2-cb0d0fe781fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:14.377805 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-e2e5490e-f2cc-4c1f-b1c2-cb0d0fe781fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lazy-loading 'services' on Instance uuid 272b6112-4d76-4d2f-84ab-4382b998c781 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:55:14.500527 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e2e5490e-f2cc-4c1f-b1c2-cb0d0fe781fe tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "DELETE /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments/4d3d5f13-1b6a-4935-afc9-07fc1577f933" status: 202 len: 0 microversion: 2.1 time: 0.304433 Jul 19 20:55:14.502093 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 321/608] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jul 19 20:55:14 2022] DELETE /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments/4d3d5f13-1b6a-4935-afc9-07fc1577f933 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:55:14.515304 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b9f0ca17-a575-4509-8c5d-56f80cda82dd tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:14.516570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b9f0ca17-a575-4509-8c5d-56f80cda82dd tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:14.530409 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b9f0ca17-a575-4509-8c5d-56f80cda82dd tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:14.530854 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b9f0ca17-a575-4509-8c5d-56f80cda82dd tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:14.531635 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b9f0ca17-a575-4509-8c5d-56f80cda82dd tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:14.532079 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b9f0ca17-a575-4509-8c5d-56f80cda82dd tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:14.565874 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b9f0ca17-a575-4509-8c5d-56f80cda82dd tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056976 Jul 19 20:55:14.566784 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 288/609] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:55:14 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:14.905678 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e2012d4c-f79f-4cac-8bb9-cb31158deba9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:14.906873 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e2012d4c-f79f-4cac-8bb9-cb31158deba9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:14.915004 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2012d4c-f79f-4cac-8bb9-cb31158deba9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:14.915636 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2012d4c-f79f-4cac-8bb9-cb31158deba9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:14.916653 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2012d4c-f79f-4cac-8bb9-cb31158deba9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:14.917500 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e2012d4c-f79f-4cac-8bb9-cb31158deba9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:15.044930 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e2012d4c-f79f-4cac-8bb9-cb31158deba9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:15.062098 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e2012d4c-f79f-4cac-8bb9-cb31158deba9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:15.065321 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e2012d4c-f79f-4cac-8bb9-cb31158deba9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:15.067600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e2012d4c-f79f-4cac-8bb9-cb31158deba9 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1286 microversion: 2.20 time: 0.170639 Jul 19 20:55:15.068664 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 322/610] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:14 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1286 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:55:15.234122 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-045c0ce2-de18-46c2-92f6-6d472422db7e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:15.235064 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-045c0ce2-de18-46c2-92f6-6d472422db7e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:15.242813 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-045c0ce2-de18-46c2-92f6-6d472422db7e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:15.243391 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-045c0ce2-de18-46c2-92f6-6d472422db7e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:15.244124 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-045c0ce2-de18-46c2-92f6-6d472422db7e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:15.244629 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-045c0ce2-de18-46c2-92f6-6d472422db7e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:15.439766 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-045c0ce2-de18-46c2-92f6-6d472422db7e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:15.454552 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-045c0ce2-de18-46c2-92f6-6d472422db7e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1558 microversion: 2.1 time: 0.224169 Jul 19 20:55:15.455615 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 289/611] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:15 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:15.483318 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-15ddf423-7bc9-4fd9-ad01-7e8a9db24b54 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:15.484170 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-15ddf423-7bc9-4fd9-ad01-7e8a9db24b54 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:15.494999 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-15ddf423-7bc9-4fd9-ad01-7e8a9db24b54 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:15.495760 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-15ddf423-7bc9-4fd9-ad01-7e8a9db24b54 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:15.497066 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-15ddf423-7bc9-4fd9-ad01-7e8a9db24b54 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:15.497866 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-15ddf423-7bc9-4fd9-ad01-7e8a9db24b54 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:15.584898 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-00a61dff-06b1-469e-805a-a30f400a39a3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:15.586556 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-00a61dff-06b1-469e-805a-a30f400a39a3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:15.599103 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-00a61dff-06b1-469e-805a-a30f400a39a3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:15.601409 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-00a61dff-06b1-469e-805a-a30f400a39a3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:15.603493 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-00a61dff-06b1-469e-805a-a30f400a39a3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:15.604545 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-00a61dff-06b1-469e-805a-a30f400a39a3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:15.667015 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-00a61dff-06b1-469e-805a-a30f400a39a3 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089518 Jul 19 20:55:15.668044 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-15ddf423-7bc9-4fd9-ad01-7e8a9db24b54 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.191671 Jul 19 20:55:15.673028 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 290/612] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:55:15 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:15.673164 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 323/613] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jul 19 20:55:15 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:55:16.092594 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-89d9ac4c-2af9-4f28-9135-4647d18c95eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:16.094627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-89d9ac4c-2af9-4f28-9135-4647d18c95eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:16.105683 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-89d9ac4c-2af9-4f28-9135-4647d18c95eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:16.106338 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-89d9ac4c-2af9-4f28-9135-4647d18c95eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:16.107564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-89d9ac4c-2af9-4f28-9135-4647d18c95eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:16.109155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-89d9ac4c-2af9-4f28-9135-4647d18c95eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:16.230488 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-89d9ac4c-2af9-4f28-9135-4647d18c95eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:16.249109 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-89d9ac4c-2af9-4f28-9135-4647d18c95eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:16.252029 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-89d9ac4c-2af9-4f28-9135-4647d18c95eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:16.253542 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-89d9ac4c-2af9-4f28-9135-4647d18c95eb tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1342 microversion: 2.20 time: 0.168079 Jul 19 20:55:16.257691 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 291/614] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:16 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:55:16.681265 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e9e63416-3e3e-4e30-9493-a1d3961ec7a1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:16.682398 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e9e63416-3e3e-4e30-9493-a1d3961ec7a1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:16.689039 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e9e63416-3e3e-4e30-9493-a1d3961ec7a1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:16.689614 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e9e63416-3e3e-4e30-9493-a1d3961ec7a1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:16.690621 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e9e63416-3e3e-4e30-9493-a1d3961ec7a1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:16.691066 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e9e63416-3e3e-4e30-9493-a1d3961ec7a1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:16.724946 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e9e63416-3e3e-4e30-9493-a1d3961ec7a1 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048083 Jul 19 20:55:16.726368 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 324/615] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:55:16 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:55:16.818668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-6e23b269-5652-4ce2-95ae-4c472213a70b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:16.820040 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-6e23b269-5652-4ce2-95ae-4c472213a70b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:16.832754 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6e23b269-5652-4ce2-95ae-4c472213a70b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:16.833279 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6e23b269-5652-4ce2-95ae-4c472213a70b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:16.834494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6e23b269-5652-4ce2-95ae-4c472213a70b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:16.835061 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6e23b269-5652-4ce2-95ae-4c472213a70b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:16.871162 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-6e23b269-5652-4ce2-95ae-4c472213a70b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:55:16.983622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-6e23b269-5652-4ce2-95ae-4c472213a70b tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "DELETE /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 204 len: 0 microversion: 2.1 time: 0.171743 Jul 19 20:55:16.984716 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 292/616] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:55:16 2022] DELETE /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:55:16.996451 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-1118fb51-3d9d-46c4-83b4-a1e0451a1f13 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:16.997071 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-1118fb51-3d9d-46c4-83b4-a1e0451a1f13 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:17.004222 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1118fb51-3d9d-46c4-83b4-a1e0451a1f13 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:17.004682 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1118fb51-3d9d-46c4-83b4-a1e0451a1f13 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:17.005594 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1118fb51-3d9d-46c4-83b4-a1e0451a1f13 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:17.006044 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1118fb51-3d9d-46c4-83b4-a1e0451a1f13 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:17.194844 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-1118fb51-3d9d-46c4-83b4-a1e0451a1f13 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:17.208439 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-1118fb51-3d9d-46c4-83b4-a1e0451a1f13 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1689 microversion: 2.1 time: 0.218364 Jul 19 20:55:17.210104 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 325/617] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:16 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:17.274839 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-14fb29a9-47d7-407d-83d2-efa908c39baa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:17.275841 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-14fb29a9-47d7-407d-83d2-efa908c39baa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:17.282965 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-14fb29a9-47d7-407d-83d2-efa908c39baa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:17.283495 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-14fb29a9-47d7-407d-83d2-efa908c39baa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:17.284335 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-14fb29a9-47d7-407d-83d2-efa908c39baa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:17.284836 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-14fb29a9-47d7-407d-83d2-efa908c39baa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:17.356695 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-14fb29a9-47d7-407d-83d2-efa908c39baa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:17.371580 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-14fb29a9-47d7-407d-83d2-efa908c39baa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:17.371580 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-14fb29a9-47d7-407d-83d2-efa908c39baa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:17.371580 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-14fb29a9-47d7-407d-83d2-efa908c39baa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1340 microversion: 2.20 time: 0.100240 Jul 19 20:55:17.372229 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 293/618] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:17 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1340 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:17.702487 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-9782d150-eee8-4ded-bdc4-56e57d1e66c4 req-e2e0bb89-1d04-4d86-be07-56c714901658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0154001-450f-477f-a952-a769ea371c70", "tag": "6dfd4f22-87be-433f-bfa4-66f03eca4dd9"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:17.713398 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-9782d150-eee8-4ded-bdc4-56e57d1e66c4 req-e2e0bb89-1d04-4d86-be07-56c714901658 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:17.714213 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-9782d150-eee8-4ded-bdc4-56e57d1e66c4 req-e2e0bb89-1d04-4d86-be07-56c714901658 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:17.728656 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-9782d150-eee8-4ded-bdc4-56e57d1e66c4 req-e2e0bb89-1d04-4d86-be07-56c714901658 service nova] Creating event network-changed:6dfd4f22-87be-433f-bfa4-66f03eca4dd9 for instance a0154001-450f-477f-a952-a769ea371c70 on hv-cinder-79987 Jul 19 20:55:17.734764 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-9782d150-eee8-4ded-bdc4-56e57d1e66c4 req-e2e0bb89-1d04-4d86-be07-56c714901658 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036809 Jul 19 20:55:17.735670 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 326/619] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:18.238494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c76f6ce0-c8ad-4d91-adc1-4723d092aae9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:18.241570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c76f6ce0-c8ad-4d91-adc1-4723d092aae9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:18.253114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c76f6ce0-c8ad-4d91-adc1-4723d092aae9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:18.253894 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c76f6ce0-c8ad-4d91-adc1-4723d092aae9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:18.255906 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c76f6ce0-c8ad-4d91-adc1-4723d092aae9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:18.256706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c76f6ce0-c8ad-4d91-adc1-4723d092aae9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:18.389329 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4a68990e-3788-4f63-a614-2ba8768f391a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:18.390892 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4a68990e-3788-4f63-a614-2ba8768f391a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:18.400792 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4a68990e-3788-4f63-a614-2ba8768f391a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:18.401663 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4a68990e-3788-4f63-a614-2ba8768f391a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:18.403029 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4a68990e-3788-4f63-a614-2ba8768f391a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:18.403682 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4a68990e-3788-4f63-a614-2ba8768f391a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:18.526480 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c76f6ce0-c8ad-4d91-adc1-4723d092aae9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:18.541008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c76f6ce0-c8ad-4d91-adc1-4723d092aae9 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1689 microversion: 2.1 time: 0.313197 Jul 19 20:55:18.542485 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 294/620] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:18 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1689 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:18.611915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4a68990e-3788-4f63-a614-2ba8768f391a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:18.620764 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4a68990e-3788-4f63-a614-2ba8768f391a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:18.622344 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4a68990e-3788-4f63-a614-2ba8768f391a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:18.623588 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4a68990e-3788-4f63-a614-2ba8768f391a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1408 microversion: 2.20 time: 0.238920 Jul 19 20:55:18.624171 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 327/621] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:18 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:55:19.561754 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-dee0a2e7-d73f-42ac-b649-17fb089ce9ed tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:19.562484 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-dee0a2e7-d73f-42ac-b649-17fb089ce9ed tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:19.570283 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dee0a2e7-d73f-42ac-b649-17fb089ce9ed tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:19.570283 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dee0a2e7-d73f-42ac-b649-17fb089ce9ed tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:19.571104 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dee0a2e7-d73f-42ac-b649-17fb089ce9ed tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:19.571546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dee0a2e7-d73f-42ac-b649-17fb089ce9ed tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:19.646021 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-63372eb3-1aff-432b-a4b5-5ea1a7e20e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:19.646782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-63372eb3-1aff-432b-a4b5-5ea1a7e20e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:19.658002 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-63372eb3-1aff-432b-a4b5-5ea1a7e20e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:19.658803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-63372eb3-1aff-432b-a4b5-5ea1a7e20e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:19.660160 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-63372eb3-1aff-432b-a4b5-5ea1a7e20e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:19.660946 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-63372eb3-1aff-432b-a4b5-5ea1a7e20e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:20.141022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-dee0a2e7-d73f-42ac-b649-17fb089ce9ed tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:20.150184 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-dee0a2e7-d73f-42ac-b649-17fb089ce9ed tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1689 microversion: 2.1 time: 0.592944 Jul 19 20:55:20.151119 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 295/622] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:19 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1689 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:20.204408 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-63372eb3-1aff-432b-a4b5-5ea1a7e20e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:20.213916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-63372eb3-1aff-432b-a4b5-5ea1a7e20e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:20.215646 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-63372eb3-1aff-432b-a4b5-5ea1a7e20e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:20.216853 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-63372eb3-1aff-432b-a4b5-5ea1a7e20e8d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1408 microversion: 2.20 time: 0.576939 Jul 19 20:55:20.217443 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 328/623] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:19 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1408 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:55:21.169953 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-13e208e3-999b-4099-8e6a-5ed6ffebc3b7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:21.170957 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-13e208e3-999b-4099-8e6a-5ed6ffebc3b7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:21.178172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-13e208e3-999b-4099-8e6a-5ed6ffebc3b7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:21.178724 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-13e208e3-999b-4099-8e6a-5ed6ffebc3b7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:21.179694 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-13e208e3-999b-4099-8e6a-5ed6ffebc3b7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:21.180139 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-13e208e3-999b-4099-8e6a-5ed6ffebc3b7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:21.238496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-818cabc5-0273-4cfb-b110-252b8dec3769 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:21.239826 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-818cabc5-0273-4cfb-b110-252b8dec3769 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:21.254123 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-818cabc5-0273-4cfb-b110-252b8dec3769 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:21.255837 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-818cabc5-0273-4cfb-b110-252b8dec3769 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:21.257260 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-818cabc5-0273-4cfb-b110-252b8dec3769 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:21.258200 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-818cabc5-0273-4cfb-b110-252b8dec3769 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:21.503401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-13e208e3-999b-4099-8e6a-5ed6ffebc3b7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:21.520425 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-13e208e3-999b-4099-8e6a-5ed6ffebc3b7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1689 microversion: 2.1 time: 0.354377 Jul 19 20:55:21.531825 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 296/624] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:21 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1689 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:21.552599 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-818cabc5-0273-4cfb-b110-252b8dec3769 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:21.567516 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-818cabc5-0273-4cfb-b110-252b8dec3769 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:21.570623 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-818cabc5-0273-4cfb-b110-252b8dec3769 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:21.573086 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-818cabc5-0273-4cfb-b110-252b8dec3769 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1408 microversion: 2.20 time: 0.341070 Jul 19 20:55:21.574905 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 329/625] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:21 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:55:22.160268 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-1a2510f4-5c3b-4fe2-93fd-9b9aaf7578c8 req-9431054f-4b09-431f-8340-46f5ec533795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fdf860c-45c6-4d7b-a438-c013db13a81d", "tag": "04ab7a63-4e2e-47fd-9f11-50e01794d069"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:22.206662 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-1a2510f4-5c3b-4fe2-93fd-9b9aaf7578c8 req-9431054f-4b09-431f-8340-46f5ec533795 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:22.211009 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-1a2510f4-5c3b-4fe2-93fd-9b9aaf7578c8 req-9431054f-4b09-431f-8340-46f5ec533795 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:22.248099 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-1a2510f4-5c3b-4fe2-93fd-9b9aaf7578c8 req-9431054f-4b09-431f-8340-46f5ec533795 service nova] Creating event network-changed:04ab7a63-4e2e-47fd-9f11-50e01794d069 for instance 0fdf860c-45c6-4d7b-a438-c013db13a81d on hv-cinder-79987 Jul 19 20:55:22.259358 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-1a2510f4-5c3b-4fe2-93fd-9b9aaf7578c8 req-9431054f-4b09-431f-8340-46f5ec533795 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122950 Jul 19 20:55:22.260361 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 297/626] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:22.541893 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-218d9210-be88-4c4c-b481-803c79285c02 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:22.542828 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-218d9210-be88-4c4c-b481-803c79285c02 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:22.550925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-218d9210-be88-4c4c-b481-803c79285c02 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:22.551905 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-218d9210-be88-4c4c-b481-803c79285c02 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:22.553127 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-218d9210-be88-4c4c-b481-803c79285c02 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:22.553696 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-218d9210-be88-4c4c-b481-803c79285c02 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:22.600304 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7abfaead-90e5-4b12-b2eb-340bdcd63751 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:22.601757 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7abfaead-90e5-4b12-b2eb-340bdcd63751 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:22.610217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7abfaead-90e5-4b12-b2eb-340bdcd63751 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:22.611091 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7abfaead-90e5-4b12-b2eb-340bdcd63751 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:22.612226 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7abfaead-90e5-4b12-b2eb-340bdcd63751 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:22.612917 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7abfaead-90e5-4b12-b2eb-340bdcd63751 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:22.655026 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-218d9210-be88-4c4c-b481-803c79285c02 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:22.674515 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-218d9210-be88-4c4c-b481-803c79285c02 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1622 microversion: 2.1 time: 0.136606 Jul 19 20:55:22.676600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 330/627] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:22 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1622 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:22.818812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7abfaead-90e5-4b12-b2eb-340bdcd63751 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:22.835114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7abfaead-90e5-4b12-b2eb-340bdcd63751 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:22.838645 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7abfaead-90e5-4b12-b2eb-340bdcd63751 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:22.840857 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7abfaead-90e5-4b12-b2eb-340bdcd63751 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1408 microversion: 2.20 time: 0.245120 Jul 19 20:55:22.844724 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 298/628] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:22 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:23.697826 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-de596d67-b825-45e7-a025-ca0fdb172339 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:23.699168 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-de596d67-b825-45e7-a025-ca0fdb172339 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:23.709833 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-de596d67-b825-45e7-a025-ca0fdb172339 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:23.710630 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-de596d67-b825-45e7-a025-ca0fdb172339 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:23.712076 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-de596d67-b825-45e7-a025-ca0fdb172339 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:23.712920 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-de596d67-b825-45e7-a025-ca0fdb172339 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:23.775147 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-de596d67-b825-45e7-a025-ca0fdb172339 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:23.775918 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-de596d67-b825-45e7-a025-ca0fdb172339 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:23.776624 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-de596d67-b825-45e7-a025-ca0fdb172339 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lazy-loading 'fault' on Instance uuid 272b6112-4d76-4d2f-84ab-4382b998c781 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:55:23.838349 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-de596d67-b825-45e7-a025-ca0fdb172339 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:23.849414 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-de596d67-b825-45e7-a025-ca0fdb172339 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1335 microversion: 2.1 time: 0.158446 Jul 19 20:55:23.850161 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 331/629] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:23 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1335 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:23.874464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ed0a3123-c380-4819-9b05-418ea2e95d22 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:23.875596 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ed0a3123-c380-4819-9b05-418ea2e95d22 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:23.880166 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:23.881203 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=10 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:23.893987 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ed0a3123-c380-4819-9b05-418ea2e95d22 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:23.894834 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ed0a3123-c380-4819-9b05-418ea2e95d22 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:23.896262 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ed0a3123-c380-4819-9b05-418ea2e95d22 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:23.897047 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ed0a3123-c380-4819-9b05-418ea2e95d22 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:24.071270 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ed0a3123-c380-4819-9b05-418ea2e95d22 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:24.082507 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ed0a3123-c380-4819-9b05-418ea2e95d22 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:24.084505 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ed0a3123-c380-4819-9b05-418ea2e95d22 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:24.085755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ed0a3123-c380-4819-9b05-418ea2e95d22 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1408 microversion: 2.20 time: 0.219731 Jul 19 20:55:24.086325 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 299/630] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:23 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:24.293449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:24.298301 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-4dff8c7c-fc2e-41cf-a6fd-faf7a2ac18fe req-c5390e8e-51db-4b8c-89a7-7a71a2373de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272b6112-4d76-4d2f-84ab-4382b998c781", "name": "network-vif-deleted", "tag": "c39b17d3-41ea-48aa-ace5-2a3ac46873d7"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:24.311079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-4dff8c7c-fc2e-41cf-a6fd-faf7a2ac18fe req-c5390e8e-51db-4b8c-89a7-7a71a2373de4 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:24.311513 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-4dff8c7c-fc2e-41cf-a6fd-faf7a2ac18fe req-c5390e8e-51db-4b8c-89a7-7a71a2373de4 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:24.336400 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-4dff8c7c-fc2e-41cf-a6fd-faf7a2ac18fe req-c5390e8e-51db-4b8c-89a7-7a71a2373de4 service nova] Creating event network-vif-deleted:c39b17d3-41ea-48aa-ace5-2a3ac46873d7 for instance 272b6112-4d76-4d2f-84ab-4382b998c781 on hv-cinder-79987 Jul 19 20:55:24.345843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-4dff8c7c-fc2e-41cf-a6fd-faf7a2ac18fe req-c5390e8e-51db-4b8c-89a7-7a71a2373de4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052707 Jul 19 20:55:24.346894 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 332/631] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:55:24.868970 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7a882f76-271f-49cd-a6ea-77b216a30509 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:24.869634 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7a882f76-271f-49cd-a6ea-77b216a30509 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:24.877547 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a882f76-271f-49cd-a6ea-77b216a30509 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:24.878286 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a882f76-271f-49cd-a6ea-77b216a30509 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:24.879025 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a882f76-271f-49cd-a6ea-77b216a30509 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:24.879666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a882f76-271f-49cd-a6ea-77b216a30509 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:24.935982 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a882f76-271f-49cd-a6ea-77b216a30509 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:24.936710 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a882f76-271f-49cd-a6ea-77b216a30509 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:24.937518 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-7a882f76-271f-49cd-a6ea-77b216a30509 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lazy-loading 'fault' on Instance uuid 272b6112-4d76-4d2f-84ab-4382b998c781 {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:55:24.989290 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7a882f76-271f-49cd-a6ea-77b216a30509 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:24.997926 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7a882f76-271f-49cd-a6ea-77b216a30509 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 200 len: 1335 microversion: 2.1 time: 0.133160 Jul 19 20:55:24.999049 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 300/632] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:24 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 1335 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:25.105980 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2776691a-01df-4a2c-b2b1-94d3c64c472e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:25.106680 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2776691a-01df-4a2c-b2b1-94d3c64c472e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:25.113901 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2776691a-01df-4a2c-b2b1-94d3c64c472e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:25.114345 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2776691a-01df-4a2c-b2b1-94d3c64c472e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:25.115141 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2776691a-01df-4a2c-b2b1-94d3c64c472e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:25.115578 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2776691a-01df-4a2c-b2b1-94d3c64c472e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:25.289979 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2776691a-01df-4a2c-b2b1-94d3c64c472e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:25.300915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2776691a-01df-4a2c-b2b1-94d3c64c472e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:25.302460 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2776691a-01df-4a2c-b2b1-94d3c64c472e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:25.303660 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2776691a-01df-4a2c-b2b1-94d3c64c472e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1408 microversion: 2.20 time: 0.202921 Jul 19 20:55:25.304228 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 333/633] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:25 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:26.016138 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-db613a21-b39e-4c8b-a99f-8d2e9ad14ac8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:26.017137 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-db613a21-b39e-4c8b-a99f-8d2e9ad14ac8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 272b6112-4d76-4d2f-84ab-4382b998c781] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:26.027670 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-db613a21-b39e-4c8b-a99f-8d2e9ad14ac8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:26.028293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-db613a21-b39e-4c8b-a99f-8d2e9ad14ac8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:26.029615 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-db613a21-b39e-4c8b-a99f-8d2e9ad14ac8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:26.030248 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-db613a21-b39e-4c8b-a99f-8d2e9ad14ac8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:26.048223 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-db613a21-b39e-4c8b-a99f-8d2e9ad14ac8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] HTTP exception thrown: Instance 272b6112-4d76-4d2f-84ab-4382b998c781 could not be found. Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-db613a21-b39e-4c8b-a99f-8d2e9ad14ac8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Request method failure captured: Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 HTTP/1.1 Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjIeNeE6tE-ebPrmYqZLKOkhuEvhTtzR4zG55Oz6qsVbdRt6XJd2QG1rQJo8ir8u5ycQmi1GJQ_v731GDE9SPVFb5LbYPGDcqwGAm-YQz_uafBtTUZcjuOM6phW7UenFGjceuk_FrYndKcIKfU_iLxW2cbkWvBF0_JuN3GJ10NFEiM Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 6cc474e26dd8444b99645279c4d133bf Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:55:26.050842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:55:26.053803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6cc474e26dd8444b99645279c4d133bf", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:55:26.053803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:55:26.053803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 6cc474e26dd8444b99645279c4d133bf Jul 19 20:55:26.053803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:55:26.053803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-ServerRescueNegativeTestJSON-1650342896-project Jul 19 20:55:26.053803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:55:26.053803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:55:26.053803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: 9fa96f51390e46e991c6e9afa385d2f7 Jul 19 20:55:26.053803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1650342896-project Jul 19 20:55:26.053803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:55:26.053803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance 272b6112-4d76-4d2f-84ab-4382b998c781 could not be found. Jul 19 20:55:26.053803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '272b6112-4d76-4d2f-84ab-4382b998c781'} Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272b6112-4d76-4d2f-84ab-4382b998c781 could not be found. Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:55:26.056486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272b6112-4d76-4d2f-84ab-4382b998c781 could not be found. Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272b6112-4d76-4d2f-84ab-4382b998c781 could not be found. Jul 19 20:55:26.059221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:55:26.061525 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-db613a21-b39e-4c8b-a99f-8d2e9ad14ac8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Returning 404 to user: Instance 272b6112-4d76-4d2f-84ab-4382b998c781 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:55:26.061525 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-db613a21-b39e-4c8b-a99f-8d2e9ad14ac8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781" status: 404 len: 111 microversion: 2.1 time: 0.041245 Jul 19 20:55:26.061525 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 301/634] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:26 2022] GET /compute/v2.1/servers/272b6112-4d76-4d2f-84ab-4382b998c781 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:55:26.069547 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-cd09c1b7-a79c-4b18-b98f-b2b7cc520a66 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '.version_select at 0x7f2527749c10>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:26.096749 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-cd09c1b7-a79c-4b18-b98f-b2b7cc520a66 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-528710661" status: 202 len: 0 microversion: 2.1 time: 0.036175 Jul 19 20:55:26.097396 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 334/635] 10.222.0.70 () {58 vars in 1217 bytes} [Tue Jul 19 20:55:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-528710661 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:55:26.329473 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f53cd9bd-fe91-4224-8f1e-75fff61fcc34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:26.330709 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f53cd9bd-fe91-4224-8f1e-75fff61fcc34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:26.345670 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f53cd9bd-fe91-4224-8f1e-75fff61fcc34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:26.346515 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f53cd9bd-fe91-4224-8f1e-75fff61fcc34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:26.348012 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f53cd9bd-fe91-4224-8f1e-75fff61fcc34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:26.348829 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f53cd9bd-fe91-4224-8f1e-75fff61fcc34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:26.603711 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f53cd9bd-fe91-4224-8f1e-75fff61fcc34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:26.618521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f53cd9bd-fe91-4224-8f1e-75fff61fcc34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:26.621979 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f53cd9bd-fe91-4224-8f1e-75fff61fcc34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:26.624375 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f53cd9bd-fe91-4224-8f1e-75fff61fcc34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1408 microversion: 2.20 time: 0.303180 Jul 19 20:55:26.625970 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 302/636] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:26 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1408 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:27.649507 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4c692614-b75a-4b34-871b-d6bf698711a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:27.650515 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4c692614-b75a-4b34-871b-d6bf698711a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:27.658374 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4c692614-b75a-4b34-871b-d6bf698711a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:27.658817 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4c692614-b75a-4b34-871b-d6bf698711a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:27.659594 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4c692614-b75a-4b34-871b-d6bf698711a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:27.660023 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4c692614-b75a-4b34-871b-d6bf698711a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:27.820778 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4c692614-b75a-4b34-871b-d6bf698711a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:27.830629 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4c692614-b75a-4b34-871b-d6bf698711a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:27.832047 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4c692614-b75a-4b34-871b-d6bf698711a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:27.833219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4c692614-b75a-4b34-871b-d6bf698711a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1408 microversion: 2.20 time: 0.188560 Jul 19 20:55:27.833843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 335/637] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:27 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:28.551309 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-16e0d89a-46d3-4a0b-a993-bf7a3849babc req-f2aa151b-db4e-4afe-a1fc-3ae8ac74e319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdf860c-45c6-4d7b-a438-c013db13a81d", "name": "network-vif-plugged", "status": "completed", "tag": "04ab7a63-4e2e-47fd-9f11-50e01794d069"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:28.563327 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-16e0d89a-46d3-4a0b-a993-bf7a3849babc req-f2aa151b-db4e-4afe-a1fc-3ae8ac74e319 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:28.564346 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-16e0d89a-46d3-4a0b-a993-bf7a3849babc req-f2aa151b-db4e-4afe-a1fc-3ae8ac74e319 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:28.568784 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:28.578699 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-16e0d89a-46d3-4a0b-a993-bf7a3849babc req-f2aa151b-db4e-4afe-a1fc-3ae8ac74e319 service nova] Creating event network-vif-plugged:04ab7a63-4e2e-47fd-9f11-50e01794d069 for instance 0fdf860c-45c6-4d7b-a438-c013db13a81d on hv-cinder-79987 Jul 19 20:55:28.584207 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-16e0d89a-46d3-4a0b-a993-bf7a3849babc req-f2aa151b-db4e-4afe-a1fc-3ae8ac74e319 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038891 Jul 19 20:55:28.585077 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 303/638] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:28.852441 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ca685695-b9a6-4772-a933-201b1396e0e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:28.853081 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ca685695-b9a6-4772-a933-201b1396e0e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:28.861646 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ca685695-b9a6-4772-a933-201b1396e0e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:28.862236 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ca685695-b9a6-4772-a933-201b1396e0e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:28.863131 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ca685695-b9a6-4772-a933-201b1396e0e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:28.863749 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ca685695-b9a6-4772-a933-201b1396e0e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:29.025341 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ca685695-b9a6-4772-a933-201b1396e0e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:29.029438 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:29.036128 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ca685695-b9a6-4772-a933-201b1396e0e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:29.037836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ca685695-b9a6-4772-a933-201b1396e0e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:29.039068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ca685695-b9a6-4772-a933-201b1396e0e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1408 microversion: 2.20 time: 0.190863 Jul 19 20:55:29.039637 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 336/639] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:28 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:29.331926 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-010e9847-ec30-4abf-8b6e-ddec48ec983e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:29.332515 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-010e9847-ec30-4abf-8b6e-ddec48ec983e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:29.340364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-010e9847-ec30-4abf-8b6e-ddec48ec983e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:29.340815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-010e9847-ec30-4abf-8b6e-ddec48ec983e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:29.341644 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-010e9847-ec30-4abf-8b6e-ddec48ec983e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:29.342576 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-010e9847-ec30-4abf-8b6e-ddec48ec983e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:29.370736 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-010e9847-ec30-4abf-8b6e-ddec48ec983e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:55:29.456262 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-010e9847-ec30-4abf-8b6e-ddec48ec983e tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "DELETE /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 204 len: 0 microversion: 2.1 time: 0.128872 Jul 19 20:55:29.457296 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 304/640] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:55:29 2022] DELETE /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:55:29.465956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-96d5798c-8fed-430c-82cc-e85b3c46cca8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:29.466587 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-96d5798c-8fed-430c-82cc-e85b3c46cca8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:29.474251 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-96d5798c-8fed-430c-82cc-e85b3c46cca8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:29.474703 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-96d5798c-8fed-430c-82cc-e85b3c46cca8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:29.475491 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-96d5798c-8fed-430c-82cc-e85b3c46cca8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:29.475922 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-96d5798c-8fed-430c-82cc-e85b3c46cca8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:29.629765 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-96d5798c-8fed-430c-82cc-e85b3c46cca8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:29.637680 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-96d5798c-8fed-430c-82cc-e85b3c46cca8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1507 microversion: 2.1 time: 0.176018 Jul 19 20:55:29.638259 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 337/641] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:29 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:30.062976 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-694c2822-78ff-4c71-9d51-5109b559c495 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:30.064170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-694c2822-78ff-4c71-9d51-5109b559c495 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:30.074120 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-694c2822-78ff-4c71-9d51-5109b559c495 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:30.074923 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-694c2822-78ff-4c71-9d51-5109b559c495 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:30.076821 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-694c2822-78ff-4c71-9d51-5109b559c495 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:30.077564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-694c2822-78ff-4c71-9d51-5109b559c495 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:30.229591 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-694c2822-78ff-4c71-9d51-5109b559c495 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:30.238930 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-694c2822-78ff-4c71-9d51-5109b559c495 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:30.241459 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-694c2822-78ff-4c71-9d51-5109b559c495 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:30.242717 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-694c2822-78ff-4c71-9d51-5109b559c495 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1408 microversion: 2.20 time: 0.188237 Jul 19 20:55:30.243489 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 305/642] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:30 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:30.655786 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ed3a44e0-ed37-4a4b-83b6-996acd309de8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:30.656338 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ed3a44e0-ed37-4a4b-83b6-996acd309de8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:30.663329 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed3a44e0-ed37-4a4b-83b6-996acd309de8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:30.663783 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed3a44e0-ed37-4a4b-83b6-996acd309de8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:30.664560 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed3a44e0-ed37-4a4b-83b6-996acd309de8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:30.664997 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed3a44e0-ed37-4a4b-83b6-996acd309de8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:30.815665 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ed3a44e0-ed37-4a4b-83b6-996acd309de8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:30.823341 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ed3a44e0-ed37-4a4b-83b6-996acd309de8 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1507 microversion: 2.1 time: 0.171567 Jul 19 20:55:30.823915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 338/643] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:30 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:31.261005 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a69b02c5-7a9c-4f84-ba44-e290b2da7070 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:31.261657 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a69b02c5-7a9c-4f84-ba44-e290b2da7070 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:31.269700 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a69b02c5-7a9c-4f84-ba44-e290b2da7070 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.270154 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a69b02c5-7a9c-4f84-ba44-e290b2da7070 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:31.270931 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a69b02c5-7a9c-4f84-ba44-e290b2da7070 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.271376 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a69b02c5-7a9c-4f84-ba44-e290b2da7070 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:31.410142 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a69b02c5-7a9c-4f84-ba44-e290b2da7070 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:31.418462 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a69b02c5-7a9c-4f84-ba44-e290b2da7070 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:31.420048 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a69b02c5-7a9c-4f84-ba44-e290b2da7070 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:31.421232 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a69b02c5-7a9c-4f84-ba44-e290b2da7070 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1600 microversion: 2.20 time: 0.164190 Jul 19 20:55:31.422555 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 306/644] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:31 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:31.442216 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b1df77b1-8556-476f-8615-8856258dde5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:31.442796 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b1df77b1-8556-476f-8615-8856258dde5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:31.449345 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b1df77b1-8556-476f-8615-8856258dde5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.449830 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b1df77b1-8556-476f-8615-8856258dde5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:31.450600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b1df77b1-8556-476f-8615-8856258dde5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.451570 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b1df77b1-8556-476f-8615-8856258dde5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:31.550712 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b1df77b1-8556-476f-8615-8856258dde5a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.112439 Jul 19 20:55:31.551311 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 339/645] 10.222.0.70 () {60 vars in 1315 bytes} [Tue Jul 19 20:55:31 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:55:31.840601 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4377d579-fa30-49de-a6e1-3cac1c77f299 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:31.841137 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4377d579-fa30-49de-a6e1-3cac1c77f299 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:31.848759 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4377d579-fa30-49de-a6e1-3cac1c77f299 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.849212 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4377d579-fa30-49de-a6e1-3cac1c77f299 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:31.850051 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4377d579-fa30-49de-a6e1-3cac1c77f299 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.850491 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4377d579-fa30-49de-a6e1-3cac1c77f299 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:32.101068 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4377d579-fa30-49de-a6e1-3cac1c77f299 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:32.116217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4377d579-fa30-49de-a6e1-3cac1c77f299 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 200 len: 1507 microversion: 2.1 time: 0.279290 Jul 19 20:55:32.117475 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 307/646] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:31 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:32.279453 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-b46615c3-54e6-45e6-be52-c1e3dedece57 req-e30157b1-6326-47d5-95b2-ae039c606a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84348ad4-6efa-4243-b5af-b5d6994c316b", "name": "network-vif-deleted", "tag": "7fd29114-ce93-4e34-847f-1dce713d7bb5"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:32.289112 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-b46615c3-54e6-45e6-be52-c1e3dedece57 req-e30157b1-6326-47d5-95b2-ae039c606a6c service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:32.289895 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-b46615c3-54e6-45e6-be52-c1e3dedece57 req-e30157b1-6326-47d5-95b2-ae039c606a6c service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:32.313114 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-b46615c3-54e6-45e6-be52-c1e3dedece57 req-e30157b1-6326-47d5-95b2-ae039c606a6c service nova] Creating event network-vif-deleted:7fd29114-ce93-4e34-847f-1dce713d7bb5 for instance 84348ad4-6efa-4243-b5af-b5d6994c316b on hv-cinder-79987 Jul 19 20:55:32.322574 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-b46615c3-54e6-45e6-be52-c1e3dedece57 req-e30157b1-6326-47d5-95b2-ae039c606a6c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048329 Jul 19 20:55:32.324022 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 340/647] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:32.810893 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-9eb57090-4f01-4a58-865a-4dc6591e5e9c req-ee7a00c6-71ab-4f76-8534-ac0593d49e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fdf860c-45c6-4d7b-a438-c013db13a81d", "tag": "04ab7a63-4e2e-47fd-9f11-50e01794d069"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:32.822003 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-9eb57090-4f01-4a58-865a-4dc6591e5e9c req-ee7a00c6-71ab-4f76-8534-ac0593d49e7d service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:32.822773 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-9eb57090-4f01-4a58-865a-4dc6591e5e9c req-ee7a00c6-71ab-4f76-8534-ac0593d49e7d service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:32.838401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-9eb57090-4f01-4a58-865a-4dc6591e5e9c req-ee7a00c6-71ab-4f76-8534-ac0593d49e7d service nova] Creating event network-changed:04ab7a63-4e2e-47fd-9f11-50e01794d069 for instance 0fdf860c-45c6-4d7b-a438-c013db13a81d on hv-cinder-79987 Jul 19 20:55:32.845157 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-9eb57090-4f01-4a58-865a-4dc6591e5e9c req-ee7a00c6-71ab-4f76-8534-ac0593d49e7d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106741 Jul 19 20:55:32.846895 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 308/648] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:33.140657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5514db14-79ef-4ed0-b0ab-7258c88fadee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:33.141546 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5514db14-79ef-4ed0-b0ab-7258c88fadee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: 84348ad4-6efa-4243-b5af-b5d6994c316b] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:33.148860 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5514db14-79ef-4ed0-b0ab-7258c88fadee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:33.149468 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5514db14-79ef-4ed0-b0ab-7258c88fadee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.150656 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5514db14-79ef-4ed0-b0ab-7258c88fadee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:33.151280 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5514db14-79ef-4ed0-b0ab-7258c88fadee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.174907 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-5514db14-79ef-4ed0-b0ab-7258c88fadee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] HTTP exception thrown: Instance 84348ad4-6efa-4243-b5af-b5d6994c316b could not be found. Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5514db14-79ef-4ed0-b0ab-7258c88fadee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Request method failure captured: Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b HTTP/1.1 Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjIeNeE6tE-ebPrmYqZLKOkhuEvhTtzR4zG55Oz6qsVbdRt6XJd2QG1rQJo8ir8u5ycQmi1GJQ_v731GDE9SPVFb5LbYPGDcqwGAm-YQz_uafBtTUZcjuOM6phW7UenFGjceuk_FrYndKcIKfU_iLxW2cbkWvBF0_JuN3GJ10NFEiM Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 6cc474e26dd8444b99645279c4d133bf Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:55:33.178233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:55:33.179558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6cc474e26dd8444b99645279c4d133bf", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:55:33.179558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:55:33.179558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 6cc474e26dd8444b99645279c4d133bf Jul 19 20:55:33.179558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:55:33.179558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-ServerRescueNegativeTestJSON-1650342896-project Jul 19 20:55:33.179558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:55:33.179558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:55:33.179558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: 9fa96f51390e46e991c6e9afa385d2f7 Jul 19 20:55:33.179558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1650342896-project Jul 19 20:55:33.179558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:55:33.179558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 84348ad4-6efa-4243-b5af-b5d6994c316b could not be found. Jul 19 20:55:33.179558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '84348ad4-6efa-4243-b5af-b5d6994c316b'} Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84348ad4-6efa-4243-b5af-b5d6994c316b could not be found. Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:55:33.180336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84348ad4-6efa-4243-b5af-b5d6994c316b could not be found. Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84348ad4-6efa-4243-b5af-b5d6994c316b could not be found. Jul 19 20:55:33.186418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:33.188284 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5514db14-79ef-4ed0-b0ab-7258c88fadee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Returning 404 to user: Instance 84348ad4-6efa-4243-b5af-b5d6994c316b could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:55:33.188284 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5514db14-79ef-4ed0-b0ab-7258c88fadee tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b" status: 404 len: 111 microversion: 2.1 time: 0.044859 Jul 19 20:55:33.188284 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 341/649] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:33 2022] GET /compute/v2.1/servers/84348ad4-6efa-4243-b5af-b5d6994c316b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:55:33.195384 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f6093629-46a6-4756-9e80-513273044b70 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:33.195957 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f6093629-46a6-4756-9e80-513273044b70 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:33.203933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f6093629-46a6-4756-9e80-513273044b70 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:33.204395 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f6093629-46a6-4756-9e80-513273044b70 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.205200 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f6093629-46a6-4756-9e80-513273044b70 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:33.205690 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f6093629-46a6-4756-9e80-513273044b70 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.237903 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f6093629-46a6-4756-9e80-513273044b70 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:55:33.362924 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f6093629-46a6-4756-9e80-513273044b70 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 204 len: 0 microversion: 2.1 time: 0.170357 Jul 19 20:55:33.363903 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 309/650] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:55:33 2022] DELETE /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:55:33.376938 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-660c0c35-5922-4256-962a-1f67fd6928d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:33.379083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-660c0c35-5922-4256-962a-1f67fd6928d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:33.393475 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-660c0c35-5922-4256-962a-1f67fd6928d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:33.394271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-660c0c35-5922-4256-962a-1f67fd6928d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.395680 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-660c0c35-5922-4256-962a-1f67fd6928d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:33.396542 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-660c0c35-5922-4256-962a-1f67fd6928d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.557385 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-660c0c35-5922-4256-962a-1f67fd6928d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:33.566194 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-660c0c35-5922-4256-962a-1f67fd6928d6 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.196339 Jul 19 20:55:33.566788 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 342/651] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:33 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:34.584293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c3537833-0c3e-49e7-a33f-530a2e14b9c7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:34.584987 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c3537833-0c3e-49e7-a33f-530a2e14b9c7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:34.592144 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c3537833-0c3e-49e7-a33f-530a2e14b9c7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:34.592590 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c3537833-0c3e-49e7-a33f-530a2e14b9c7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:34.593474 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c3537833-0c3e-49e7-a33f-530a2e14b9c7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:34.593982 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c3537833-0c3e-49e7-a33f-530a2e14b9c7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:34.750130 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c3537833-0c3e-49e7-a33f-530a2e14b9c7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:34.758384 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c3537833-0c3e-49e7-a33f-530a2e14b9c7 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.178246 Jul 19 20:55:34.761408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 310/652] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:34 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:35.776286 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-12e73737-2fa0-44f6-811c-129e0b05d34d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:35.776901 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-12e73737-2fa0-44f6-811c-129e0b05d34d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:35.784587 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12e73737-2fa0-44f6-811c-129e0b05d34d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:35.785017 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12e73737-2fa0-44f6-811c-129e0b05d34d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:35.785921 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12e73737-2fa0-44f6-811c-129e0b05d34d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:35.786360 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12e73737-2fa0-44f6-811c-129e0b05d34d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:35.921627 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-12e73737-2fa0-44f6-811c-129e0b05d34d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fa96f51390e46e991c6e9afa385d2f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc474e26dd8444b99645279c4d133bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:35.929511 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-12e73737-2fa0-44f6-811c-129e0b05d34d tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 200 len: 1522 microversion: 2.1 time: 0.157233 Jul 19 20:55:35.930107 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 343/653] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:35 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:36.411372 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-5ac16d00-47c5-41d9-a131-2cc807a05661 req-89a65fa4-e598-4839-81d1-79a2157eefd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07400b5-bd6a-4841-a97c-3c7e6704de6a", "name": "network-vif-deleted", "tag": "1fd8ecd1-9064-4baf-96ff-c66e1f84b6b5"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:36.421313 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-5ac16d00-47c5-41d9-a131-2cc807a05661 req-89a65fa4-e598-4839-81d1-79a2157eefd5 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:36.421845 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-5ac16d00-47c5-41d9-a131-2cc807a05661 req-89a65fa4-e598-4839-81d1-79a2157eefd5 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:36.434556 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-5ac16d00-47c5-41d9-a131-2cc807a05661 req-89a65fa4-e598-4839-81d1-79a2157eefd5 service nova] Creating event network-vif-deleted:1fd8ecd1-9064-4baf-96ff-c66e1f84b6b5 for instance b07400b5-bd6a-4841-a97c-3c7e6704de6a on hv-cinder-79987 Jul 19 20:55:36.442032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-5ac16d00-47c5-41d9-a131-2cc807a05661 req-89a65fa4-e598-4839-81d1-79a2157eefd5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034154 Jul 19 20:55:36.443013 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 311/654] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:36.946525 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6d469e59-f16f-4388-96a7-ebfef2d60933 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:36.947134 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6d469e59-f16f-4388-96a7-ebfef2d60933 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] [instance: b07400b5-bd6a-4841-a97c-3c7e6704de6a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:36.954856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6d469e59-f16f-4388-96a7-ebfef2d60933 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:36.955295 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6d469e59-f16f-4388-96a7-ebfef2d60933 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:36.956455 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6d469e59-f16f-4388-96a7-ebfef2d60933 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:36.956895 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6d469e59-f16f-4388-96a7-ebfef2d60933 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:36.973915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-6d469e59-f16f-4388-96a7-ebfef2d60933 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] HTTP exception thrown: Instance b07400b5-bd6a-4841-a97c-3c7e6704de6a could not be found. Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6d469e59-f16f-4388-96a7-ebfef2d60933 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Request method failure captured: Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a HTTP/1.1 Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjIeNeE6tE-ebPrmYqZLKOkhuEvhTtzR4zG55Oz6qsVbdRt6XJd2QG1rQJo8ir8u5ycQmi1GJQ_v731GDE9SPVFb5LbYPGDcqwGAm-YQz_uafBtTUZcjuOM6phW7UenFGjceuk_FrYndKcIKfU_iLxW2cbkWvBF0_JuN3GJ10NFEiM Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 6cc474e26dd8444b99645279c4d133bf Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:55:36.975448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:55:36.977406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6cc474e26dd8444b99645279c4d133bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6cc474e26dd8444b99645279c4d133bf", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:55:36.977406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:55:36.977406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 6cc474e26dd8444b99645279c4d133bf Jul 19 20:55:36.977406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1650342896 Jul 19 20:55:36.977406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-ServerRescueNegativeTestJSON-1650342896-project Jul 19 20:55:36.977406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:55:36.977406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:55:36.977406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: 9fa96f51390e46e991c6e9afa385d2f7 Jul 19 20:55:36.977406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1650342896-project Jul 19 20:55:36.977406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:55:36.977406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance b07400b5-bd6a-4841-a97c-3c7e6704de6a could not be found. Jul 19 20:55:36.977406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': 'b07400b5-bd6a-4841-a97c-3c7e6704de6a'} Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b07400b5-bd6a-4841-a97c-3c7e6704de6a could not be found. Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:55:36.978166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b07400b5-bd6a-4841-a97c-3c7e6704de6a could not be found. Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b07400b5-bd6a-4841-a97c-3c7e6704de6a could not be found. Jul 19 20:55:36.979431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:55:36.980521 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6d469e59-f16f-4388-96a7-ebfef2d60933 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] Returning 404 to user: Instance b07400b5-bd6a-4841-a97c-3c7e6704de6a could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:55:36.980521 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6d469e59-f16f-4388-96a7-ebfef2d60933 tempest-ServerRescueNegativeTestJSON-1650342896 tempest-ServerRescueNegativeTestJSON-1650342896-project] 10.222.0.70 "GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a" status: 404 len: 111 microversion: 2.1 time: 0.034356 Jul 19 20:55:36.980521 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 344/655] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:36 2022] GET /compute/v2.1/servers/b07400b5-bd6a-4841-a97c-3c7e6704de6a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:56:12.392671 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c7aa9b40-568b-470b-9193-d93c17fb4522 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:12.395672 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c7aa9b40-568b-470b-9193-d93c17fb4522 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:12.411804 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:12.413801 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:12.442809 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c7aa9b40-568b-470b-9193-d93c17fb4522 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:12.443606 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c7aa9b40-568b-470b-9193-d93c17fb4522 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:12.444605 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c7aa9b40-568b-470b-9193-d93c17fb4522 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:12.445422 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c7aa9b40-568b-470b-9193-d93c17fb4522 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:12.496512 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c7aa9b40-568b-470b-9193-d93c17fb4522 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127185 Jul 19 20:56:12.497538 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 312/656] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:56:12 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:56:12.589767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-de4ae926-f6cd-491b-b18f-474803260e30 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:12.590313 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-de4ae926-f6cd-491b-b18f-474803260e30 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:12.604851 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:12.607890 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=34 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:12.613116 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-de4ae926-f6cd-491b-b18f-474803260e30 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:12.613988 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-de4ae926-f6cd-491b-b18f-474803260e30 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:12.615153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-de4ae926-f6cd-491b-b18f-474803260e30 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:12.616101 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-de4ae926-f6cd-491b-b18f-474803260e30 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:12.655149 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-de4ae926-f6cd-491b-b18f-474803260e30 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Going to try to terminate instance {{(pid=129866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:56:12.758713 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-de4ae926-f6cd-491b-b18f-474803260e30 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 204 len: 0 microversion: 2.1 time: 0.173407 Jul 19 20:56:12.759337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 345/657] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:56:12 2022] DELETE /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:56:12.768495 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5e18706f-d4e3-40f2-9d0f-f402bfbba99f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:12.769109 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5e18706f-d4e3-40f2-9d0f-f402bfbba99f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:12.779259 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5e18706f-d4e3-40f2-9d0f-f402bfbba99f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:12.780755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5e18706f-d4e3-40f2-9d0f-f402bfbba99f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:12.782169 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5e18706f-d4e3-40f2-9d0f-f402bfbba99f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:12.782616 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5e18706f-d4e3-40f2-9d0f-f402bfbba99f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:13.068853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5e18706f-d4e3-40f2-9d0f-f402bfbba99f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:13.083916 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5e18706f-d4e3-40f2-9d0f-f402bfbba99f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1670 microversion: 2.1 time: 0.320015 Jul 19 20:56:13.094419 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 313/658] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:12 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1670 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:14.102893 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-994a9ff5-8b92-43f5-9971-dc39c94be6b0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:14.103885 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-994a9ff5-8b92-43f5-9971-dc39c94be6b0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:14.113837 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-994a9ff5-8b92-43f5-9971-dc39c94be6b0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:14.116931 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-994a9ff5-8b92-43f5-9971-dc39c94be6b0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:14.119108 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-994a9ff5-8b92-43f5-9971-dc39c94be6b0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:14.119792 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-994a9ff5-8b92-43f5-9971-dc39c94be6b0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:14.643515 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-994a9ff5-8b92-43f5-9971-dc39c94be6b0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:14.652913 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-994a9ff5-8b92-43f5-9971-dc39c94be6b0 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1670 microversion: 2.1 time: 0.554382 Jul 19 20:56:14.670012 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 346/659] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:14 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1670 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:15.350130 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-d8fdd5bb-f29d-4550-b274-b48ac434d9a5 req-5cf34427-1bab-4b21-b692-96346cb11d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44e702b-f4f1-46e4-8552-a9440c7b13db", "name": "network-vif-deleted", "tag": "5659d43b-6dee-4967-bcd6-71cb55872ddb"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:15.362859 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-d8fdd5bb-f29d-4550-b274-b48ac434d9a5 req-5cf34427-1bab-4b21-b692-96346cb11d0d service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:15.363538 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-d8fdd5bb-f29d-4550-b274-b48ac434d9a5 req-5cf34427-1bab-4b21-b692-96346cb11d0d service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:15.387162 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-d8fdd5bb-f29d-4550-b274-b48ac434d9a5 req-5cf34427-1bab-4b21-b692-96346cb11d0d service nova] Creating event network-vif-deleted:5659d43b-6dee-4967-bcd6-71cb55872ddb for instance c44e702b-f4f1-46e4-8552-a9440c7b13db on hv-cinder-79987 Jul 19 20:56:15.402576 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-d8fdd5bb-f29d-4550-b274-b48ac434d9a5 req-5cf34427-1bab-4b21-b692-96346cb11d0d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056166 Jul 19 20:56:15.418353 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 314/660] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:15.672659 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-1bf57187-5bae-4e14-a644-584dd30b3d5e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:15.674714 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-1bf57187-5bae-4e14-a644-584dd30b3d5e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:15.683276 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1bf57187-5bae-4e14-a644-584dd30b3d5e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:15.691298 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1bf57187-5bae-4e14-a644-584dd30b3d5e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:15.692561 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1bf57187-5bae-4e14-a644-584dd30b3d5e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:15.693070 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1bf57187-5bae-4e14-a644-584dd30b3d5e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:15.732766 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1bf57187-5bae-4e14-a644-584dd30b3d5e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:15.733223 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1bf57187-5bae-4e14-a644-584dd30b3d5e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:15.733710 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-1bf57187-5bae-4e14-a644-584dd30b3d5e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lazy-loading 'fault' on Instance uuid c44e702b-f4f1-46e4-8552-a9440c7b13db {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:56:15.778158 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-1bf57187-5bae-4e14-a644-584dd30b3d5e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:15.786711 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-1bf57187-5bae-4e14-a644-584dd30b3d5e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 200 len: 1327 microversion: 2.1 time: 0.119480 Jul 19 20:56:15.788279 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 347/661] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:15 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 1327 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:16.826207 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f1645cc8-5296-438e-a766-190fe13a562c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:16.829767 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f1645cc8-5296-438e-a766-190fe13a562c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:16.847992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1645cc8-5296-438e-a766-190fe13a562c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:16.848874 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1645cc8-5296-438e-a766-190fe13a562c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:16.849905 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1645cc8-5296-438e-a766-190fe13a562c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:16.850494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1645cc8-5296-438e-a766-190fe13a562c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:16.866608 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-f1645cc8-5296-438e-a766-190fe13a562c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] HTTP exception thrown: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f1645cc8-5296-438e-a766-190fe13a562c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Request method failure captured: Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db HTTP/1.1 Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xkdOHPMo0ZDheibj24z53s-RHDYk04kuCXYu79D7z7Zo3AjwC8g3SRpYNv--IJBTdVXwbxIhkbhWrMXSRuf1j_CyhvyThRij5Mub88TEVTwOK6Void5SpaWeScquXIgQRGKHhp7CcTuNp8q3hpKh6ux9mwrkQihBqb-f4c9FMeJUI4 Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: a35c1526c58f4c2b9b44a4de6c945846 Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:56:16.868322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:56:16.870020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a35c1526c58f4c2b9b44a4de6c945846", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:56:16.870020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:56:16.870020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: a35c1526c58f4c2b9b44a4de6c945846 Jul 19 20:56:16.870020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:56:16.870020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeTestJSON-431306425-project Jul 19 20:56:16.870020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:56:16.870020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:56:16.870020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: cbcb993e2d1842389c5862f0fdb7d4d7 Jul 19 20:56:16.870020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeTestJSON-431306425-project Jul 19 20:56:16.870020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:56:16.870020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:56:16.870020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': 'c44e702b-f4f1-46e4-8552-a9440c7b13db'} Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:56:16.870980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:56:16.872553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:56:16.875601 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f1645cc8-5296-438e-a766-190fe13a562c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Returning 404 to user: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:56:16.883089 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f1645cc8-5296-438e-a766-190fe13a562c tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 404 len: 111 microversion: 2.1 time: 0.080450 Jul 19 20:56:16.888198 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 315/662] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:16 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:56:16.899122 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5f2b5abd-9e24-4ee5-93dd-68f135ffa084 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '.version_select at 0x7f25277b8940>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:16.922135 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5f2b5abd-9e24-4ee5-93dd-68f135ffa084 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666159502" status: 202 len: 0 microversion: 2.1 time: 0.028309 Jul 19 20:56:16.923619 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 348/663] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jul 19 20:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666159502 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:56:17.857921 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-83c6c23e-5ad9-4dd4-8d35-84a201ab19b4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Action: 'create', calling method: .version_select at 0x7f2534266310>, body: {"keypair": {"name": "tempest-keypair-1264261786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVd6Wytya38/+RaPmaGypDIsi/mmGzUPE4HGJmhETsRGDoOHWg8RKIqwqxWl72/No0mL730gPVWd+KwnyqZrKV27zqn3f7zsjZGI+llMgnCRsZgbOCi7ng6FaxtuAreiw=="}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:17.880772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-83c6c23e-5ad9-4dd4-8d35-84a201ab19b4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Getting quotas for project a35c1526c58f4c2b9b44a4de6c945846. Resources: {'key_pairs'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:56:17.887264 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-83c6c23e-5ad9-4dd4-8d35-84a201ab19b4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Getting quotas for user cbcb993e2d1842389c5862f0fdb7d4d7 and project a35c1526c58f4c2b9b44a4de6c945846. Resources: {'key_pairs'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:56:17.924968 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-83c6c23e-5ad9-4dd4-8d35-84a201ab19b4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071940 Jul 19 20:56:17.925669 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 316/664] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jul 19 20:56:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:19.863191 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-62116827", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90c4c149-ef7c-4874-8f2b-fb097608ec8f"}], "security_groups": [{"name": "tempest-securitygroup--2127092370"}], "key_name": "tempest-keypair-1264261786", "user_data": "}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:19.978764 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.network.neutron [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] validate_networks() for [('90c4c149-ef7c-4874-8f2b-fb097608ec8f', None, None, None, None, None)] {{(pid=129866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:56:20.447441 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Flavor limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:56:20.448077 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Image limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:56:20.448769 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Flavor pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:56:20.449411 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Image pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:56:20.450030 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:56:20.462884 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:20.463457 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:20.464519 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:20.465021 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:20.486582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Getting quotas for project a35c1526c58f4c2b9b44a4de6c945846. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:56:20.491495 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Getting quotas for user cbcb993e2d1842389c5862f0fdb7d4d7 and project a35c1526c58f4c2b9b44a4de6c945846. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:56:20.508585 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Going to run 1 instances... {{(pid=129866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:56:20.511753 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:56:20.572172 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8aa9a85d-9933-4c59-883f-6c61ce2b931b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.715942 Jul 19 20:56:20.573062 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 349/665] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:56:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:56:20.584304 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a66abc9c-9705-4a8d-be36-bb19b7807608 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:20.584985 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a66abc9c-9705-4a8d-be36-bb19b7807608 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:20.659846 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a66abc9c-9705-4a8d-be36-bb19b7807608 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:20.667404 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a66abc9c-9705-4a8d-be36-bb19b7807608 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1236 microversion: 2.1 time: 0.087716 Jul 19 20:56:20.668824 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 317/666] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:20 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:21.691998 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ed913ebd-26ac-4c4f-9008-f6f95e8aabff tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:21.694294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ed913ebd-26ac-4c4f-9008-f6f95e8aabff tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:21.701600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed913ebd-26ac-4c4f-9008-f6f95e8aabff tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:21.702393 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed913ebd-26ac-4c4f-9008-f6f95e8aabff tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:21.707384 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed913ebd-26ac-4c4f-9008-f6f95e8aabff tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:21.708484 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ed913ebd-26ac-4c4f-9008-f6f95e8aabff tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:21.790678 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ed913ebd-26ac-4c4f-9008-f6f95e8aabff tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:21.801902 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ed913ebd-26ac-4c4f-9008-f6f95e8aabff tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1296 microversion: 2.1 time: 0.120111 Jul 19 20:56:21.803297 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 350/667] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:21 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1296 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:22.820778 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2d02f83e-d51f-4681-8b9a-debce8e39ca9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:22.822057 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2d02f83e-d51f-4681-8b9a-debce8e39ca9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:22.830649 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d02f83e-d51f-4681-8b9a-debce8e39ca9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:22.831255 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d02f83e-d51f-4681-8b9a-debce8e39ca9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:22.832251 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d02f83e-d51f-4681-8b9a-debce8e39ca9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:22.832921 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d02f83e-d51f-4681-8b9a-debce8e39ca9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:23.030843 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2d02f83e-d51f-4681-8b9a-debce8e39ca9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:23.049908 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2d02f83e-d51f-4681-8b9a-debce8e39ca9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.234045 Jul 19 20:56:23.051286 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 318/668] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:22 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:23.841888 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-692b676c-d5f8-44ca-ba49-e9df2937ea51 req-a996c80f-61e1-4699-ac3b-5d9a2a8a2823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5f79f8-fd4f-4f06-9078-b32830789ea6", "tag": "6a3b6b2d-c9b2-47ae-ae20-42c88989fd47"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:23.897735 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-692b676c-d5f8-44ca-ba49-e9df2937ea51 req-a996c80f-61e1-4699-ac3b-5d9a2a8a2823 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:23.898721 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-692b676c-d5f8-44ca-ba49-e9df2937ea51 req-a996c80f-61e1-4699-ac3b-5d9a2a8a2823 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:23.915813 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-692b676c-d5f8-44ca-ba49-e9df2937ea51 req-a996c80f-61e1-4699-ac3b-5d9a2a8a2823 service nova] Creating event network-changed:6a3b6b2d-c9b2-47ae-ae20-42c88989fd47 for instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 on hv-cinder-79987 Jul 19 20:56:23.923700 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-692b676c-d5f8-44ca-ba49-e9df2937ea51 req-a996c80f-61e1-4699-ac3b-5d9a2a8a2823 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093679 Jul 19 20:56:23.924843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 351/669] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:24.070168 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0d28eccb-9d0d-44d1-9ff1-5fdb217aefa6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:24.071815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0d28eccb-9d0d-44d1-9ff1-5fdb217aefa6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:24.081263 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0d28eccb-9d0d-44d1-9ff1-5fdb217aefa6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:24.081563 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0d28eccb-9d0d-44d1-9ff1-5fdb217aefa6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:24.082370 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0d28eccb-9d0d-44d1-9ff1-5fdb217aefa6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:24.083466 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0d28eccb-9d0d-44d1-9ff1-5fdb217aefa6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:24.294580 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0d28eccb-9d0d-44d1-9ff1-5fdb217aefa6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:24.307859 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0d28eccb-9d0d-44d1-9ff1-5fdb217aefa6 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.242876 Jul 19 20:56:24.309694 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 319/670] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:24 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:25.326933 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e7d8f2e7-c3cf-47e1-b3ef-887921cb1820 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:25.328899 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e7d8f2e7-c3cf-47e1-b3ef-887921cb1820 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:25.335871 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e7d8f2e7-c3cf-47e1-b3ef-887921cb1820 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:25.336651 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e7d8f2e7-c3cf-47e1-b3ef-887921cb1820 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:25.337541 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e7d8f2e7-c3cf-47e1-b3ef-887921cb1820 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:25.338392 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e7d8f2e7-c3cf-47e1-b3ef-887921cb1820 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:25.493867 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e7d8f2e7-c3cf-47e1-b3ef-887921cb1820 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:25.502717 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e7d8f2e7-c3cf-47e1-b3ef-887921cb1820 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.179889 Jul 19 20:56:25.503297 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 352/671] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:25 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:26.489243 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a4b13660-7cb8-4e95-9bdf-ff056419ea5c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Action: 'create', calling method: .version_select at 0x7f2534081c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1525586410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0QK/gEUmeHb9uSiFVG0piR3RS29XPpiOLHDPxWxnDp2XmzvuLGN/FjQDHB+FHz55UD9K6EzF7oB0MwfZ3PPJ2wHF0FHDfBNdP5XKknpRFMykqnAguGHq1x7tzCLxqBtA=="}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:26.503270 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-a4b13660-7cb8-4e95-9bdf-ff056419ea5c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Getting quotas for project 3dcf50fca2134c84812de75fed624869. Resources: {'key_pairs'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:56:26.506962 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-a4b13660-7cb8-4e95-9bdf-ff056419ea5c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Getting quotas for user c0bbce46598c465bb29cb0353f10e3eb and project 3dcf50fca2134c84812de75fed624869. Resources: {'key_pairs'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:56:26.520561 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0ef7cd0d-3085-4f41-be19-18e6e40d5f0e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:26.521170 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0ef7cd0d-3085-4f41-be19-18e6e40d5f0e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:26.528128 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0ef7cd0d-3085-4f41-be19-18e6e40d5f0e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:26.528586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0ef7cd0d-3085-4f41-be19-18e6e40d5f0e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:26.529278 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a4b13660-7cb8-4e95-9bdf-ff056419ea5c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.043873 Jul 19 20:56:26.529600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0ef7cd0d-3085-4f41-be19-18e6e40d5f0e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:26.529918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 320/672] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jul 19 20:56:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:56:26.541540 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0ef7cd0d-3085-4f41-be19-18e6e40d5f0e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:26.583251 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-4237488", "imageRef": "21bbd014-0034-4639-8f73-881d8a388e29", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1525586410", "networks": [{"uuid": "bb222f7a-e22d-4c64-a614-bf18fda96757"}]}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:26.636376 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.network.neutron [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] validate_networks() for [('bb222f7a-e22d-4c64-a614-bf18fda96757', None, None, None, None, None)] {{(pid=129867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:56:26.739079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0ef7cd0d-3085-4f41-be19-18e6e40d5f0e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:26.749066 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0ef7cd0d-3085-4f41-be19-18e6e40d5f0e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.232287 Jul 19 20:56:26.760428 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 353/673] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:26 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:27.042104 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Flavor limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:56:27.042546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Image limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:56:27.043017 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Flavor pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:56:27.043425 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Image pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:56:27.043833 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:56:27.053987 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:27.054432 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:27.055224 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:27.055709 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:27.074588 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Getting quotas for project 3dcf50fca2134c84812de75fed624869. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:56:27.078456 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Getting quotas for user c0bbce46598c465bb29cb0353f10e3eb and project 3dcf50fca2134c84812de75fed624869. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:56:27.090569 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Going to run 1 instances... {{(pid=129867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:56:27.092686 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='21bbd014-0034-4639-8f73-881d8a388e29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:56:27.141741 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-89930f06-a3c7-4d28-b928-f663b6219d1c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563441 Jul 19 20:56:27.142575 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 321/674] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:56:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:56:27.152466 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-072108af-9c9f-4382-9477-2691551e8754 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:27.153228 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-072108af-9c9f-4382-9477-2691551e8754 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:27.211526 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-072108af-9c9f-4382-9477-2691551e8754 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:27.218194 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-072108af-9c9f-4382-9477-2691551e8754 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1256 microversion: 2.1 time: 0.069753 Jul 19 20:56:27.227348 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 354/675] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:27 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1256 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:27.768150 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8e99a9ea-bbdf-4333-9e79-9c195a2c21b8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:27.768761 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8e99a9ea-bbdf-4333-9e79-9c195a2c21b8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:27.775461 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8e99a9ea-bbdf-4333-9e79-9c195a2c21b8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:27.775912 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8e99a9ea-bbdf-4333-9e79-9c195a2c21b8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:27.776681 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8e99a9ea-bbdf-4333-9e79-9c195a2c21b8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:27.777124 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8e99a9ea-bbdf-4333-9e79-9c195a2c21b8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:27.910067 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8e99a9ea-bbdf-4333-9e79-9c195a2c21b8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:27.917659 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8e99a9ea-bbdf-4333-9e79-9c195a2c21b8 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.154313 Jul 19 20:56:27.918263 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 322/676] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:27 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:28.235701 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-71fda4a5-8abe-4905-8e01-fee6be4b522d tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:28.237763 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-71fda4a5-8abe-4905-8e01-fee6be4b522d tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:28.246902 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71fda4a5-8abe-4905-8e01-fee6be4b522d tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:28.247744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71fda4a5-8abe-4905-8e01-fee6be4b522d tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:28.248576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71fda4a5-8abe-4905-8e01-fee6be4b522d tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:28.249225 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71fda4a5-8abe-4905-8e01-fee6be4b522d tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:28.326262 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-71fda4a5-8abe-4905-8e01-fee6be4b522d tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:28.335301 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-71fda4a5-8abe-4905-8e01-fee6be4b522d tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1326 microversion: 2.1 time: 0.103901 Jul 19 20:56:28.335858 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 355/677] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:28 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:28.759473 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-5b63024d-90b8-428d-bad3-262138f5b8dd req-1645ee51-e5a2-4144-a502-ded6e7a03f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5f79f8-fd4f-4f06-9078-b32830789ea6", "name": "network-vif-plugged", "status": "completed", "tag": "6a3b6b2d-c9b2-47ae-ae20-42c88989fd47"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:28.778167 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-5b63024d-90b8-428d-bad3-262138f5b8dd req-1645ee51-e5a2-4144-a502-ded6e7a03f33 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:28.780265 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-5b63024d-90b8-428d-bad3-262138f5b8dd req-1645ee51-e5a2-4144-a502-ded6e7a03f33 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:28.796791 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-5b63024d-90b8-428d-bad3-262138f5b8dd req-1645ee51-e5a2-4144-a502-ded6e7a03f33 service nova] Creating event network-vif-plugged:6a3b6b2d-c9b2-47ae-ae20-42c88989fd47 for instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 on hv-cinder-79987 Jul 19 20:56:28.802921 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-5b63024d-90b8-428d-bad3-262138f5b8dd req-1645ee51-e5a2-4144-a502-ded6e7a03f33 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049132 Jul 19 20:56:28.804887 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 323/678] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:28.935307 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-aade0fe5-4f14-4b9b-8a02-6d8becaa7350 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:28.936150 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-aade0fe5-4f14-4b9b-8a02-6d8becaa7350 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:28.950007 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aade0fe5-4f14-4b9b-8a02-6d8becaa7350 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:28.951108 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aade0fe5-4f14-4b9b-8a02-6d8becaa7350 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:28.952102 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aade0fe5-4f14-4b9b-8a02-6d8becaa7350 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:28.953519 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aade0fe5-4f14-4b9b-8a02-6d8becaa7350 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:29.181767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-aade0fe5-4f14-4b9b-8a02-6d8becaa7350 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:29.197942 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-aade0fe5-4f14-4b9b-8a02-6d8becaa7350 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.267313 Jul 19 20:56:29.198975 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 356/679] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:28 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:29.353453 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7e309c1f-713e-4037-8244-922bc6c39663 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:29.354110 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7e309c1f-713e-4037-8244-922bc6c39663 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:29.367230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7e309c1f-713e-4037-8244-922bc6c39663 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:29.368090 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7e309c1f-713e-4037-8244-922bc6c39663 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:29.369131 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7e309c1f-713e-4037-8244-922bc6c39663 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:29.369818 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7e309c1f-713e-4037-8244-922bc6c39663 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:29.535627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7e309c1f-713e-4037-8244-922bc6c39663 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:29.543352 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7e309c1f-713e-4037-8244-922bc6c39663 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.194817 Jul 19 20:56:29.543923 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 324/680] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:29 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:30.218253 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c09eecfa-75b3-42aa-bd02-695003b563d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:30.218907 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c09eecfa-75b3-42aa-bd02-695003b563d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:30.225933 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c09eecfa-75b3-42aa-bd02-695003b563d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:30.226375 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c09eecfa-75b3-42aa-bd02-695003b563d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:30.227138 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c09eecfa-75b3-42aa-bd02-695003b563d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:30.227568 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c09eecfa-75b3-42aa-bd02-695003b563d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:30.392199 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c09eecfa-75b3-42aa-bd02-695003b563d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:30.400263 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c09eecfa-75b3-42aa-bd02-695003b563d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.188694 Jul 19 20:56:30.400833 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 357/681] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:30 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:30.560207 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5bef2385-3ca0-41c2-8976-a242f907eb62 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:30.560850 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5bef2385-3ca0-41c2-8976-a242f907eb62 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:30.568922 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5bef2385-3ca0-41c2-8976-a242f907eb62 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:30.569573 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5bef2385-3ca0-41c2-8976-a242f907eb62 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:30.570351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5bef2385-3ca0-41c2-8976-a242f907eb62 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:30.570870 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5bef2385-3ca0-41c2-8976-a242f907eb62 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:30.718119 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5bef2385-3ca0-41c2-8976-a242f907eb62 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:30.726001 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5bef2385-3ca0-41c2-8976-a242f907eb62 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.169574 Jul 19 20:56:30.726765 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 325/682] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:30 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:31.418361 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-fb443941-8ab2-401b-8634-792e106b31bd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:31.418970 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-fb443941-8ab2-401b-8634-792e106b31bd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:31.420925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:31.427716 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb443941-8ab2-401b-8634-792e106b31bd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:31.428176 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb443941-8ab2-401b-8634-792e106b31bd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:31.428946 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb443941-8ab2-401b-8634-792e106b31bd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:31.429412 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb443941-8ab2-401b-8634-792e106b31bd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:31.570588 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-fb443941-8ab2-401b-8634-792e106b31bd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:31.578755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-fb443941-8ab2-401b-8634-792e106b31bd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.164197 Jul 19 20:56:31.579328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 358/683] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:31 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:31.744990 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-10d95ec9-2939-4c66-ab71-b8f05a3a2355 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:31.745656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-10d95ec9-2939-4c66-ab71-b8f05a3a2355 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:31.752804 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-10d95ec9-2939-4c66-ab71-b8f05a3a2355 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:31.753284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-10d95ec9-2939-4c66-ab71-b8f05a3a2355 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:31.754096 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-10d95ec9-2939-4c66-ab71-b8f05a3a2355 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:31.754586 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-10d95ec9-2939-4c66-ab71-b8f05a3a2355 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:31.894649 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-10d95ec9-2939-4c66-ab71-b8f05a3a2355 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:31.902395 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-10d95ec9-2939-4c66-ab71-b8f05a3a2355 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.162228 Jul 19 20:56:31.903242 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 326/684] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:31 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:32.605150 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4edd1554-5b6d-465e-a8c8-9f57dbb01516 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:32.605786 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4edd1554-5b6d-465e-a8c8-9f57dbb01516 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:32.612707 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4edd1554-5b6d-465e-a8c8-9f57dbb01516 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:32.613152 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4edd1554-5b6d-465e-a8c8-9f57dbb01516 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:32.613945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4edd1554-5b6d-465e-a8c8-9f57dbb01516 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:32.614402 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4edd1554-5b6d-465e-a8c8-9f57dbb01516 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:32.751588 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4edd1554-5b6d-465e-a8c8-9f57dbb01516 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:32.758924 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4edd1554-5b6d-465e-a8c8-9f57dbb01516 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.157933 Jul 19 20:56:32.759490 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 359/685] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:32 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:32.919783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f2e80428-ce8c-4e76-903d-76c87e85e390 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:32.920546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f2e80428-ce8c-4e76-903d-76c87e85e390 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:32.927687 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f2e80428-ce8c-4e76-903d-76c87e85e390 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:32.928148 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f2e80428-ce8c-4e76-903d-76c87e85e390 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:32.928929 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f2e80428-ce8c-4e76-903d-76c87e85e390 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:32.929400 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f2e80428-ce8c-4e76-903d-76c87e85e390 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:33.075023 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f2e80428-ce8c-4e76-903d-76c87e85e390 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:33.083595 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f2e80428-ce8c-4e76-903d-76c87e85e390 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.167987 Jul 19 20:56:33.084356 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 327/686] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:32 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:33.776859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dea5aa77-f4c3-4fc9-97fc-1fdced73e1ee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:33.777456 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-dea5aa77-f4c3-4fc9-97fc-1fdced73e1ee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:33.783697 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dea5aa77-f4c3-4fc9-97fc-1fdced73e1ee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:33.784143 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dea5aa77-f4c3-4fc9-97fc-1fdced73e1ee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:33.784903 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dea5aa77-f4c3-4fc9-97fc-1fdced73e1ee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:33.785350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dea5aa77-f4c3-4fc9-97fc-1fdced73e1ee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:33.922149 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dea5aa77-f4c3-4fc9-97fc-1fdced73e1ee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:33.937205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dea5aa77-f4c3-4fc9-97fc-1fdced73e1ee tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.164696 Jul 19 20:56:33.938684 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 360/687] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:33 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:34.100555 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-cbe950b5-6182-42d6-8a2f-7f51ddb0517e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:34.101290 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-cbe950b5-6182-42d6-8a2f-7f51ddb0517e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:34.108084 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cbe950b5-6182-42d6-8a2f-7f51ddb0517e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:34.108644 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cbe950b5-6182-42d6-8a2f-7f51ddb0517e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:34.109932 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cbe950b5-6182-42d6-8a2f-7f51ddb0517e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:34.110374 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cbe950b5-6182-42d6-8a2f-7f51ddb0517e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:34.258053 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-cbe950b5-6182-42d6-8a2f-7f51ddb0517e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:34.265872 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-cbe950b5-6182-42d6-8a2f-7f51ddb0517e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.169260 Jul 19 20:56:34.266667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 328/688] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:34 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:34.955843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8c0e6575-09b9-4193-8d96-58c54869a275 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:34.957234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8c0e6575-09b9-4193-8d96-58c54869a275 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:34.964689 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8c0e6575-09b9-4193-8d96-58c54869a275 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:34.965230 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8c0e6575-09b9-4193-8d96-58c54869a275 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:34.966184 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8c0e6575-09b9-4193-8d96-58c54869a275 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:34.966618 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8c0e6575-09b9-4193-8d96-58c54869a275 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:35.148035 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-8c0e6575-09b9-4193-8d96-58c54869a275 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:35.156762 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8c0e6575-09b9-4193-8d96-58c54869a275 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.204831 Jul 19 20:56:35.161688 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 361/689] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:34 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:35.284654 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a115eb69-bcb2-4074-80ef-926087928887 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:35.285250 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a115eb69-bcb2-4074-80ef-926087928887 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:35.292078 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a115eb69-bcb2-4074-80ef-926087928887 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:35.292534 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a115eb69-bcb2-4074-80ef-926087928887 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:35.293318 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a115eb69-bcb2-4074-80ef-926087928887 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:35.293790 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a115eb69-bcb2-4074-80ef-926087928887 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:35.428173 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a115eb69-bcb2-4074-80ef-926087928887 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:35.435747 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a115eb69-bcb2-4074-80ef-926087928887 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.156290 Jul 19 20:56:35.436378 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 329/690] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:35 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:36.176532 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-34e4d76e-685d-4f40-900f-51ea4ca9b878 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:36.177275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-34e4d76e-685d-4f40-900f-51ea4ca9b878 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:36.185123 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-34e4d76e-685d-4f40-900f-51ea4ca9b878 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:36.185781 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-34e4d76e-685d-4f40-900f-51ea4ca9b878 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:36.186624 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-34e4d76e-685d-4f40-900f-51ea4ca9b878 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:36.187129 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-34e4d76e-685d-4f40-900f-51ea4ca9b878 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:36.330379 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-34e4d76e-685d-4f40-900f-51ea4ca9b878 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:36.334236 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:36.338692 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-34e4d76e-685d-4f40-900f-51ea4ca9b878 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.167155 Jul 19 20:56:36.348181 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 362/691] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:36 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:36.452221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4d716027-0b17-489d-a026-3bc3fb2c4893 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:36.452965 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4d716027-0b17-489d-a026-3bc3fb2c4893 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:36.459370 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4d716027-0b17-489d-a026-3bc3fb2c4893 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:36.459829 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4d716027-0b17-489d-a026-3bc3fb2c4893 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:36.460731 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4d716027-0b17-489d-a026-3bc3fb2c4893 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:36.461181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4d716027-0b17-489d-a026-3bc3fb2c4893 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:36.621251 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4d716027-0b17-489d-a026-3bc3fb2c4893 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:36.629479 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4d716027-0b17-489d-a026-3bc3fb2c4893 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.181090 Jul 19 20:56:36.630036 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 330/692] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:36 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:37.356694 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4e5d2f34-11cd-4a01-bd1b-0bcb501081ec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:37.356694 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4e5d2f34-11cd-4a01-bd1b-0bcb501081ec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:37.361924 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=8 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:37.367567 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4e5d2f34-11cd-4a01-bd1b-0bcb501081ec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:37.368016 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4e5d2f34-11cd-4a01-bd1b-0bcb501081ec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:37.380896 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4e5d2f34-11cd-4a01-bd1b-0bcb501081ec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:37.381682 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4e5d2f34-11cd-4a01-bd1b-0bcb501081ec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:37.561659 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4e5d2f34-11cd-4a01-bd1b-0bcb501081ec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:37.576541 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4e5d2f34-11cd-4a01-bd1b-0bcb501081ec tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.224610 Jul 19 20:56:37.577091 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 363/693] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:37 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:37.646625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a114994d-ee89-486f-8ea7-a0443650b828 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:37.647344 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a114994d-ee89-486f-8ea7-a0443650b828 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:37.649445 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:37.650194 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=16 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:37.657269 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a114994d-ee89-486f-8ea7-a0443650b828 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:37.657752 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a114994d-ee89-486f-8ea7-a0443650b828 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:37.658533 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a114994d-ee89-486f-8ea7-a0443650b828 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:37.658974 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a114994d-ee89-486f-8ea7-a0443650b828 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:37.797749 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a114994d-ee89-486f-8ea7-a0443650b828 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:37.805584 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a114994d-ee89-486f-8ea7-a0443650b828 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.162663 Jul 19 20:56:37.806284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 331/694] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:37 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:38.595229 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a32fa918-8838-4042-a500-033ef4ea7aeb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:38.595868 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a32fa918-8838-4042-a500-033ef4ea7aeb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:38.602573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a32fa918-8838-4042-a500-033ef4ea7aeb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:38.603022 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a32fa918-8838-4042-a500-033ef4ea7aeb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:38.604393 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a32fa918-8838-4042-a500-033ef4ea7aeb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:38.604515 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a32fa918-8838-4042-a500-033ef4ea7aeb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:38.742480 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-a32fa918-8838-4042-a500-033ef4ea7aeb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:38.750767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a32fa918-8838-4042-a500-033ef4ea7aeb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.159958 Jul 19 20:56:38.751344 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 364/695] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:38 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:38.823180 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c9cfbaba-9e3d-4750-a193-f6aef99119db tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:38.823793 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c9cfbaba-9e3d-4750-a193-f6aef99119db tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:38.830987 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c9cfbaba-9e3d-4750-a193-f6aef99119db tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:38.831444 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c9cfbaba-9e3d-4750-a193-f6aef99119db tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:38.832211 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c9cfbaba-9e3d-4750-a193-f6aef99119db tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:38.832651 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c9cfbaba-9e3d-4750-a193-f6aef99119db tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:38.966071 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c9cfbaba-9e3d-4750-a193-f6aef99119db tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:38.974428 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c9cfbaba-9e3d-4750-a193-f6aef99119db tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.155129 Jul 19 20:56:38.975001 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 332/696] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:38 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:39.768322 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-75834df1-e6aa-45dc-a5a5-f5ea30b0841e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:39.768874 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-75834df1-e6aa-45dc-a5a5-f5ea30b0841e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:39.775537 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-75834df1-e6aa-45dc-a5a5-f5ea30b0841e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:39.775987 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-75834df1-e6aa-45dc-a5a5-f5ea30b0841e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:39.776758 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-75834df1-e6aa-45dc-a5a5-f5ea30b0841e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:39.777226 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-75834df1-e6aa-45dc-a5a5-f5ea30b0841e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:39.908076 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-75834df1-e6aa-45dc-a5a5-f5ea30b0841e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:39.915766 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-75834df1-e6aa-45dc-a5a5-f5ea30b0841e tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.151851 Jul 19 20:56:39.916340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 365/697] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:39 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:39.991516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9c1aaaf4-dc2c-4e06-b4b4-7f688388652f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:39.992096 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9c1aaaf4-dc2c-4e06-b4b4-7f688388652f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:39.998654 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9c1aaaf4-dc2c-4e06-b4b4-7f688388652f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:39.999168 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9c1aaaf4-dc2c-4e06-b4b4-7f688388652f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:39.999931 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9c1aaaf4-dc2c-4e06-b4b4-7f688388652f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:40.000357 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9c1aaaf4-dc2c-4e06-b4b4-7f688388652f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:40.131469 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9c1aaaf4-dc2c-4e06-b4b4-7f688388652f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:40.138782 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9c1aaaf4-dc2c-4e06-b4b4-7f688388652f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.151201 Jul 19 20:56:40.139342 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 333/698] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:39 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:40.932572 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c77d160f-5acd-4407-8834-ec8fb43e09ba tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:40.933166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c77d160f-5acd-4407-8834-ec8fb43e09ba tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:40.941695 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c77d160f-5acd-4407-8834-ec8fb43e09ba tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:40.942143 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c77d160f-5acd-4407-8834-ec8fb43e09ba tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:40.942936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c77d160f-5acd-4407-8834-ec8fb43e09ba tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:40.943380 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c77d160f-5acd-4407-8834-ec8fb43e09ba tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:41.082927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c77d160f-5acd-4407-8834-ec8fb43e09ba tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:41.092521 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c77d160f-5acd-4407-8834-ec8fb43e09ba tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.163682 Jul 19 20:56:41.093102 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 366/699] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:40 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:41.157000 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fef1a05a-c7ad-4599-a150-e4ff5d954f4e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:41.157710 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-fef1a05a-c7ad-4599-a150-e4ff5d954f4e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:41.164546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fef1a05a-c7ad-4599-a150-e4ff5d954f4e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:41.165000 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fef1a05a-c7ad-4599-a150-e4ff5d954f4e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:41.165817 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fef1a05a-c7ad-4599-a150-e4ff5d954f4e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:41.166256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fef1a05a-c7ad-4599-a150-e4ff5d954f4e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:41.171477 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=100 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:41.301108 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-fef1a05a-c7ad-4599-a150-e4ff5d954f4e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:41.308622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fef1a05a-c7ad-4599-a150-e4ff5d954f4e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.155635 Jul 19 20:56:41.309183 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 334/700] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:41 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:42.110492 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-61e9b805-7a08-4eda-a5ec-b80c937f56cd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:42.111125 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-61e9b805-7a08-4eda-a5ec-b80c937f56cd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:42.117728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-61e9b805-7a08-4eda-a5ec-b80c937f56cd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:42.118181 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-61e9b805-7a08-4eda-a5ec-b80c937f56cd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:42.118950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-61e9b805-7a08-4eda-a5ec-b80c937f56cd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:42.119395 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-61e9b805-7a08-4eda-a5ec-b80c937f56cd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:42.255417 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-61e9b805-7a08-4eda-a5ec-b80c937f56cd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:42.263214 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-61e9b805-7a08-4eda-a5ec-b80c937f56cd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.157203 Jul 19 20:56:42.263783 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 367/701] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:42 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:42.325374 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ebea4af0-ea52-46fd-a94c-4a3f983d3565 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:42.325983 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ebea4af0-ea52-46fd-a94c-4a3f983d3565 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:42.332492 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ebea4af0-ea52-46fd-a94c-4a3f983d3565 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:42.332937 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ebea4af0-ea52-46fd-a94c-4a3f983d3565 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:42.333729 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ebea4af0-ea52-46fd-a94c-4a3f983d3565 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:42.334164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ebea4af0-ea52-46fd-a94c-4a3f983d3565 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:42.461325 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ebea4af0-ea52-46fd-a94c-4a3f983d3565 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:42.468728 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ebea4af0-ea52-46fd-a94c-4a3f983d3565 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.147235 Jul 19 20:56:42.470007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 335/702] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:42 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:43.280242 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b88d6d3a-aa3b-4e5a-ae69-c15c51ecc8de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:43.280856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b88d6d3a-aa3b-4e5a-ae69-c15c51ecc8de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:43.287215 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:43.289239 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b88d6d3a-aa3b-4e5a-ae69-c15c51ecc8de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:43.289827 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b88d6d3a-aa3b-4e5a-ae69-c15c51ecc8de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:43.290671 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b88d6d3a-aa3b-4e5a-ae69-c15c51ecc8de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:43.291176 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b88d6d3a-aa3b-4e5a-ae69-c15c51ecc8de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:43.303134 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-96445753-0d7f-49a2-aae8-866b7735113d req-56382e18-73a3-4e4e-be20-62c94463cc9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebc1845-f1c0-4b88-b056-045377c6ef1c", "tag": "1ccc96a0-961a-4491-b458-91a6ced6d896"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:43.320021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=5 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:43.322727 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-96445753-0d7f-49a2-aae8-866b7735113d req-56382e18-73a3-4e4e-be20-62c94463cc9c service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:43.324360 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-96445753-0d7f-49a2-aae8-866b7735113d req-56382e18-73a3-4e4e-be20-62c94463cc9c service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:43.342211 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-96445753-0d7f-49a2-aae8-866b7735113d req-56382e18-73a3-4e4e-be20-62c94463cc9c service nova] Creating event network-changed:1ccc96a0-961a-4491-b458-91a6ced6d896 for instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c on hv-cinder-79987 Jul 19 20:56:43.349190 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-96445753-0d7f-49a2-aae8-866b7735113d req-56382e18-73a3-4e4e-be20-62c94463cc9c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056049 Jul 19 20:56:43.350995 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 336/703] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:43.462946 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b88d6d3a-aa3b-4e5a-ae69-c15c51ecc8de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:43.473459 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b88d6d3a-aa3b-4e5a-ae69-c15c51ecc8de tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.197046 Jul 19 20:56:43.474756 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 368/704] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:43 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:43.488458 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-db16dbb2-8f42-429c-a173-61992066ee7a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:43.489434 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-db16dbb2-8f42-429c-a173-61992066ee7a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:43.496221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-db16dbb2-8f42-429c-a173-61992066ee7a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:43.496819 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-db16dbb2-8f42-429c-a173-61992066ee7a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:43.497741 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-db16dbb2-8f42-429c-a173-61992066ee7a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:43.498285 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-db16dbb2-8f42-429c-a173-61992066ee7a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:43.635629 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-db16dbb2-8f42-429c-a173-61992066ee7a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:43.643521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-db16dbb2-8f42-429c-a173-61992066ee7a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.160473 Jul 19 20:56:43.644086 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 337/705] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:43 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:44.491974 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-19c75567-87a9-4c90-893f-ad56fd533727 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:44.492558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-19c75567-87a9-4c90-893f-ad56fd533727 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:44.499014 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-19c75567-87a9-4c90-893f-ad56fd533727 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:44.499453 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-19c75567-87a9-4c90-893f-ad56fd533727 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:44.500207 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-19c75567-87a9-4c90-893f-ad56fd533727 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:44.500642 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-19c75567-87a9-4c90-893f-ad56fd533727 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:44.644392 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-19c75567-87a9-4c90-893f-ad56fd533727 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:44.651988 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-19c75567-87a9-4c90-893f-ad56fd533727 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.163873 Jul 19 20:56:44.652565 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 369/706] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:44 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:44.659856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2041bf29-db4f-4374-9c46-6a77fb2266fd tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:44.660460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2041bf29-db4f-4374-9c46-6a77fb2266fd tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:44.667017 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2041bf29-db4f-4374-9c46-6a77fb2266fd tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:44.667459 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2041bf29-db4f-4374-9c46-6a77fb2266fd tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:44.668221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2041bf29-db4f-4374-9c46-6a77fb2266fd tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:44.668762 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2041bf29-db4f-4374-9c46-6a77fb2266fd tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:44.798619 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2041bf29-db4f-4374-9c46-6a77fb2266fd tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:44.806012 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2041bf29-db4f-4374-9c46-6a77fb2266fd tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.150596 Jul 19 20:56:44.806567 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 338/707] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:44 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:45.669785 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a4ff2cd0-5106-464e-b83f-a7168d81d5d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:45.670345 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a4ff2cd0-5106-464e-b83f-a7168d81d5d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:45.677419 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a4ff2cd0-5106-464e-b83f-a7168d81d5d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:45.677883 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a4ff2cd0-5106-464e-b83f-a7168d81d5d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:45.678646 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a4ff2cd0-5106-464e-b83f-a7168d81d5d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:45.679084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a4ff2cd0-5106-464e-b83f-a7168d81d5d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:45.815252 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-a4ff2cd0-5106-464e-b83f-a7168d81d5d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:45.823651 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a4ff2cd0-5106-464e-b83f-a7168d81d5d7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.157781 Jul 19 20:56:45.823991 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2e93771d-cbe5-470c-9395-bd3122c7d4f6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:45.824612 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 370/708] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:45 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:45.824814 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2e93771d-cbe5-470c-9395-bd3122c7d4f6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:45.835411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2e93771d-cbe5-470c-9395-bd3122c7d4f6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:45.835411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2e93771d-cbe5-470c-9395-bd3122c7d4f6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:45.835411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2e93771d-cbe5-470c-9395-bd3122c7d4f6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:45.835411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2e93771d-cbe5-470c-9395-bd3122c7d4f6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:45.974517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2e93771d-cbe5-470c-9395-bd3122c7d4f6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:45.982519 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2e93771d-cbe5-470c-9395-bd3122c7d4f6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.163414 Jul 19 20:56:45.983683 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 339/709] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:45 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:46.840099 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-98d177d1-eb60-4968-a5ec-a4e0d36f8918 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:46.840694 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-98d177d1-eb60-4968-a5ec-a4e0d36f8918 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:46.847133 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-98d177d1-eb60-4968-a5ec-a4e0d36f8918 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:46.847577 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-98d177d1-eb60-4968-a5ec-a4e0d36f8918 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:46.848320 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-98d177d1-eb60-4968-a5ec-a4e0d36f8918 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:46.848750 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-98d177d1-eb60-4968-a5ec-a4e0d36f8918 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:47.005889 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c8e7a1a2-83b6-4c3d-a607-3a71f77d174c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:47.007433 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c8e7a1a2-83b6-4c3d-a607-3a71f77d174c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:47.013185 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-98d177d1-eb60-4968-a5ec-a4e0d36f8918 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:47.015911 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c8e7a1a2-83b6-4c3d-a607-3a71f77d174c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:47.016447 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c8e7a1a2-83b6-4c3d-a607-3a71f77d174c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:47.017274 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c8e7a1a2-83b6-4c3d-a607-3a71f77d174c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:47.017773 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c8e7a1a2-83b6-4c3d-a607-3a71f77d174c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:47.024715 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-98d177d1-eb60-4968-a5ec-a4e0d36f8918 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1362 microversion: 2.1 time: 0.188396 Jul 19 20:56:47.025669 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 371/710] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:46 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:47.160349 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c8e7a1a2-83b6-4c3d-a607-3a71f77d174c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:47.167773 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c8e7a1a2-83b6-4c3d-a607-3a71f77d174c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.166949 Jul 19 20:56:47.168357 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 340/711] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:46 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:48.045801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-31e0131c-cb7b-42a7-b99b-5c18e473bc37 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:48.046774 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-31e0131c-cb7b-42a7-b99b-5c18e473bc37 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:48.053311 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-31e0131c-cb7b-42a7-b99b-5c18e473bc37 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:48.053792 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-31e0131c-cb7b-42a7-b99b-5c18e473bc37 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:48.054572 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-31e0131c-cb7b-42a7-b99b-5c18e473bc37 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:48.055011 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-31e0131c-cb7b-42a7-b99b-5c18e473bc37 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:48.185419 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0cd1a384-e81a-49a9-b2f6-8e33fdaa60f8 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:48.185926 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0cd1a384-e81a-49a9-b2f6-8e33fdaa60f8 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:48.188302 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-31e0131c-cb7b-42a7-b99b-5c18e473bc37 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:48.193391 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0cd1a384-e81a-49a9-b2f6-8e33fdaa60f8 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:48.193788 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0cd1a384-e81a-49a9-b2f6-8e33fdaa60f8 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:48.194570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0cd1a384-e81a-49a9-b2f6-8e33fdaa60f8 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:48.195020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0cd1a384-e81a-49a9-b2f6-8e33fdaa60f8 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:48.197056 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-31e0131c-cb7b-42a7-b99b-5c18e473bc37 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1548 microversion: 2.1 time: 0.155497 Jul 19 20:56:48.197702 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 372/712] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:48 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:48.214136 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a2d4e83a-9ef6-4f98-b9df-0ebceede5bd9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:48.214632 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a2d4e83a-9ef6-4f98-b9df-0ebceede5bd9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:48.221108 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a2d4e83a-9ef6-4f98-b9df-0ebceede5bd9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:48.221608 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a2d4e83a-9ef6-4f98-b9df-0ebceede5bd9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:48.222387 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a2d4e83a-9ef6-4f98-b9df-0ebceede5bd9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:48.222825 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a2d4e83a-9ef6-4f98-b9df-0ebceede5bd9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:48.334598 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a2d4e83a-9ef6-4f98-b9df-0ebceede5bd9 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124346 Jul 19 20:56:48.335203 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 373/713] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jul 19 20:56:48 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:56:48.367348 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0cd1a384-e81a-49a9-b2f6-8e33fdaa60f8 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:48.377771 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0cd1a384-e81a-49a9-b2f6-8e33fdaa60f8 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.196537 Jul 19 20:56:48.378366 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 341/714] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:48 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:49.269922 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-58907d19-2c5f-49b8-9f50-b25a30bc200a req-208d0017-00ea-43a6-9294-0fa81e1652b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5f79f8-fd4f-4f06-9078-b32830789ea6", "tag": "6a3b6b2d-c9b2-47ae-ae20-42c88989fd47"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:49.278505 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-58907d19-2c5f-49b8-9f50-b25a30bc200a req-208d0017-00ea-43a6-9294-0fa81e1652b2 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:49.278971 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-58907d19-2c5f-49b8-9f50-b25a30bc200a req-208d0017-00ea-43a6-9294-0fa81e1652b2 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:49.293445 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-58907d19-2c5f-49b8-9f50-b25a30bc200a req-208d0017-00ea-43a6-9294-0fa81e1652b2 service nova] Creating event network-changed:6a3b6b2d-c9b2-47ae-ae20-42c88989fd47 for instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 on hv-cinder-79987 Jul 19 20:56:49.302301 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-58907d19-2c5f-49b8-9f50-b25a30bc200a req-208d0017-00ea-43a6-9294-0fa81e1652b2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034522 Jul 19 20:56:49.303571 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 374/715] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:49.394666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-44e070da-6301-4d35-9dfc-c7da46f64eaa tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:49.395276 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-44e070da-6301-4d35-9dfc-c7da46f64eaa tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:49.402580 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-44e070da-6301-4d35-9dfc-c7da46f64eaa tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:49.403718 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-44e070da-6301-4d35-9dfc-c7da46f64eaa tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:49.404597 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-44e070da-6301-4d35-9dfc-c7da46f64eaa tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:49.405170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-44e070da-6301-4d35-9dfc-c7da46f64eaa tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:49.543838 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-44e070da-6301-4d35-9dfc-c7da46f64eaa tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:49.552658 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-44e070da-6301-4d35-9dfc-c7da46f64eaa tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.162003 Jul 19 20:56:49.553261 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 342/716] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:49 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:50.570894 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-80d090e6-0ea4-467e-b036-f2a469bf19cc tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:50.571582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-80d090e6-0ea4-467e-b036-f2a469bf19cc tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:50.578076 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-80d090e6-0ea4-467e-b036-f2a469bf19cc tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:50.578475 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-80d090e6-0ea4-467e-b036-f2a469bf19cc tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:50.579245 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-80d090e6-0ea4-467e-b036-f2a469bf19cc tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:50.580280 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-80d090e6-0ea4-467e-b036-f2a469bf19cc tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:50.712891 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-80d090e6-0ea4-467e-b036-f2a469bf19cc tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:50.720950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-80d090e6-0ea4-467e-b036-f2a469bf19cc tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.154736 Jul 19 20:56:50.721564 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 375/717] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:50 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:50.795087 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-2abe8804-3995-4ea5-a915-fa6dfdb4fe22 req-5568549e-ce75-484d-a2f4-cab170bc7c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebc1845-f1c0-4b88-b056-045377c6ef1c", "name": "network-vif-plugged", "status": "completed", "tag": "1ccc96a0-961a-4491-b458-91a6ced6d896"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:50.804884 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-2abe8804-3995-4ea5-a915-fa6dfdb4fe22 req-5568549e-ce75-484d-a2f4-cab170bc7c9c service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:50.805457 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-2abe8804-3995-4ea5-a915-fa6dfdb4fe22 req-5568549e-ce75-484d-a2f4-cab170bc7c9c service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:50.817510 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-2abe8804-3995-4ea5-a915-fa6dfdb4fe22 req-5568549e-ce75-484d-a2f4-cab170bc7c9c service nova] Creating event network-vif-plugged:1ccc96a0-961a-4491-b458-91a6ced6d896 for instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c on hv-cinder-79987 Jul 19 20:56:50.822803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-2abe8804-3995-4ea5-a915-fa6dfdb4fe22 req-5568549e-ce75-484d-a2f4-cab170bc7c9c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031779 Jul 19 20:56:50.823645 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 343/718] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:56:51.737969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8a60e62c-4955-4034-96b5-c740cd2c6e5a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:51.738599 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8a60e62c-4955-4034-96b5-c740cd2c6e5a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:51.744868 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8a60e62c-4955-4034-96b5-c740cd2c6e5a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:51.745310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8a60e62c-4955-4034-96b5-c740cd2c6e5a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:51.746101 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8a60e62c-4955-4034-96b5-c740cd2c6e5a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:51.746528 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8a60e62c-4955-4034-96b5-c740cd2c6e5a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:51.886312 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-8a60e62c-4955-4034-96b5-c740cd2c6e5a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:51.893993 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8a60e62c-4955-4034-96b5-c740cd2c6e5a tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1356 microversion: 2.1 time: 0.160578 Jul 19 20:56:51.894756 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 376/719] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:51 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:52.912809 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ea0b594e-84e4-40cd-921b-6d50d45dbbf4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:52.913635 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ea0b594e-84e4-40cd-921b-6d50d45dbbf4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:52.920256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ea0b594e-84e4-40cd-921b-6d50d45dbbf4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:52.920703 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ea0b594e-84e4-40cd-921b-6d50d45dbbf4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:52.921508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ea0b594e-84e4-40cd-921b-6d50d45dbbf4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:52.921961 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ea0b594e-84e4-40cd-921b-6d50d45dbbf4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:53.057538 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ea0b594e-84e4-40cd-921b-6d50d45dbbf4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:53.065464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ea0b594e-84e4-40cd-921b-6d50d45dbbf4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1547 microversion: 2.1 time: 0.158382 Jul 19 20:56:53.066049 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 344/720] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:52 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:53.082010 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c68f16ab-e4af-42bd-8d9f-a5c28a569cbb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:53.082624 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c68f16ab-e4af-42bd-8d9f-a5c28a569cbb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:53.089126 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c68f16ab-e4af-42bd-8d9f-a5c28a569cbb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:53.089617 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c68f16ab-e4af-42bd-8d9f-a5c28a569cbb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:53.090386 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c68f16ab-e4af-42bd-8d9f-a5c28a569cbb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:53.090826 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c68f16ab-e4af-42bd-8d9f-a5c28a569cbb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:53.448665 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c68f16ab-e4af-42bd-8d9f-a5c28a569cbb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:53.456899 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c68f16ab-e4af-42bd-8d9f-a5c28a569cbb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1547 microversion: 2.1 time: 0.379219 Jul 19 20:56:53.457493 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 377/721] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:53 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1547 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:53.472332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-bdeaef60-3b13-40b6-acd6-8cb081b2b0ee tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:53.475810 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-bdeaef60-3b13-40b6-acd6-8cb081b2b0ee tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:53.476574 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-bdeaef60-3b13-40b6-acd6-8cb081b2b0ee tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Searching by: {'deleted': False, 'project_id': '3dcf50fca2134c84812de75fed624869'} {{(pid=129867) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 20:56:53.483857 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bdeaef60-3b13-40b6-acd6-8cb081b2b0ee tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:53.484411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bdeaef60-3b13-40b6-acd6-8cb081b2b0ee tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:53.485214 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bdeaef60-3b13-40b6-acd6-8cb081b2b0ee tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:53.485687 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bdeaef60-3b13-40b6-acd6-8cb081b2b0ee tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:53.574778 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.multi_cell_list [None req-bdeaef60-3b13-40b6-acd6-8cb081b2b0ee tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129867) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 20:56:53.666622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-bdeaef60-3b13-40b6-acd6-8cb081b2b0ee tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.197999 Jul 19 20:56:53.667208 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 345/722] 10.222.0.70 () {58 vars in 1124 bytes} [Tue Jul 19 20:56:53 2022] GET /compute/v2.1/servers => generated 340 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:53.677976 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f4abd067-0d7a-4947-b971-5826873d350b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:53.678592 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f4abd067-0d7a-4947-b971-5826873d350b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:53.684857 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f4abd067-0d7a-4947-b971-5826873d350b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:53.685310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f4abd067-0d7a-4947-b971-5826873d350b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:53.686106 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f4abd067-0d7a-4947-b971-5826873d350b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:53.686544 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f4abd067-0d7a-4947-b971-5826873d350b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:53.812270 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f4abd067-0d7a-4947-b971-5826873d350b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:53.820360 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f4abd067-0d7a-4947-b971-5826873d350b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1547 microversion: 2.1 time: 0.146834 Jul 19 20:56:53.820921 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 378/723] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:53 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:55.358518 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9d42a1a6-b836-4af5-be6e-2764132ed175 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36a33cac-883b-434a-9ec0-c8adbdb467ee"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:55.359580 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9d42a1a6-b836-4af5-be6e-2764132ed175 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:55.366054 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9d42a1a6-b836-4af5-be6e-2764132ed175 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:55.366506 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9d42a1a6-b836-4af5-be6e-2764132ed175 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:55.367281 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9d42a1a6-b836-4af5-be6e-2764132ed175 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:55.367714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9d42a1a6-b836-4af5-be6e-2764132ed175 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:55.586878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0df07557-44ec-4a8d-857f-747a963a1434 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:55.587705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0df07557-44ec-4a8d-857f-747a963a1434 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:55.594930 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0df07557-44ec-4a8d-857f-747a963a1434 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:55.595416 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0df07557-44ec-4a8d-857f-747a963a1434 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:55.596498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0df07557-44ec-4a8d-857f-747a963a1434 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:55.597014 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0df07557-44ec-4a8d-857f-747a963a1434 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:55.608716 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9d42a1a6-b836-4af5-be6e-2764132ed175 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "POST /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253963 Jul 19 20:56:55.612591 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 346/724] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 20:56:55 2022] POST /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:55.627987 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0df07557-44ec-4a8d-857f-747a963a1434 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/ips" status: 200 len: 151 microversion: 2.1 time: 0.045559 Jul 19 20:56:55.628968 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 379/725] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jul 19 20:56:55 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:56:56.980113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-3b2d5f27-b80a-4960-ae58-56a124269413 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64af7ecf-f6ac-4493-a0d0-5d8074d007b7"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:56.981304 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-3b2d5f27-b80a-4960-ae58-56a124269413 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:56.987645 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3b2d5f27-b80a-4960-ae58-56a124269413 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:56.988098 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3b2d5f27-b80a-4960-ae58-56a124269413 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:56.988859 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3b2d5f27-b80a-4960-ae58-56a124269413 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:56.989305 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3b2d5f27-b80a-4960-ae58-56a124269413 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:57.239072 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-3b2d5f27-b80a-4960-ae58-56a124269413 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263881 Jul 19 20:56:57.239696 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 347/726] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 20:56:56 2022] POST /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:02.700062 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-201f81bf-7cd3-41d9-a029-82b1e732a444 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:02.700646 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-201f81bf-7cd3-41d9-a029-82b1e732a444 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:02.708392 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-201f81bf-7cd3-41d9-a029-82b1e732a444 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:02.708841 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-201f81bf-7cd3-41d9-a029-82b1e732a444 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:02.709638 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-201f81bf-7cd3-41d9-a029-82b1e732a444 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:02.710079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-201f81bf-7cd3-41d9-a029-82b1e732a444 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:02.736691 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-201f81bf-7cd3-41d9-a029-82b1e732a444 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/ips" status: 200 len: 152 microversion: 2.20 time: 0.041475 Jul 19 20:57:02.737804 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 380/727] 10.222.0.70 () {60 vars in 1288 bytes} [Tue Jul 19 20:57:02 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:57:03.180136 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-066bf173-596a-45aa-a638-b7268f72dad6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:03.180832 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-066bf173-596a-45aa-a638-b7268f72dad6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:03.187675 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-066bf173-596a-45aa-a638-b7268f72dad6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:03.188127 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-066bf173-596a-45aa-a638-b7268f72dad6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:03.188899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-066bf173-596a-45aa-a638-b7268f72dad6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:03.189338 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-066bf173-596a-45aa-a638-b7268f72dad6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:03.324996 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-066bf173-596a-45aa-a638-b7268f72dad6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:03.336897 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-066bf173-596a-45aa-a638-b7268f72dad6 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1593 microversion: 2.1 time: 0.160466 Jul 19 20:57:03.337965 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 348/728] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:03 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:05.248437 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-ac050955-47ab-446c-b253-480fbdc09b9e req-2fe8b6f3-b6dd-48c4-bac6-c9cae7dbb6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebc1845-f1c0-4b88-b056-045377c6ef1c", "tag": "1ccc96a0-961a-4491-b458-91a6ced6d896"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:05.258296 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-ac050955-47ab-446c-b253-480fbdc09b9e req-2fe8b6f3-b6dd-48c4-bac6-c9cae7dbb6d6 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:05.258706 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-ac050955-47ab-446c-b253-480fbdc09b9e req-2fe8b6f3-b6dd-48c4-bac6-c9cae7dbb6d6 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:05.271584 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=100 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:05.274134 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-ac050955-47ab-446c-b253-480fbdc09b9e req-2fe8b6f3-b6dd-48c4-bac6-c9cae7dbb6d6 service nova] Creating event network-changed:1ccc96a0-961a-4491-b458-91a6ced6d896 for instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c on hv-cinder-79987 Jul 19 20:57:05.279659 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-ac050955-47ab-446c-b253-480fbdc09b9e req-2fe8b6f3-b6dd-48c4-bac6-c9cae7dbb6d6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034802 Jul 19 20:57:05.280593 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 381/729] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:06.037956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fce46dac-da88-47ce-a3ce-c40d4c803469 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:06.039038 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-fce46dac-da88-47ce-a3ce-c40d4c803469 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:06.051454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:06.057266 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fce46dac-da88-47ce-a3ce-c40d4c803469 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:06.058612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fce46dac-da88-47ce-a3ce-c40d4c803469 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:06.060042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fce46dac-da88-47ce-a3ce-c40d4c803469 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:06.061572 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fce46dac-da88-47ce-a3ce-c40d4c803469 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:06.104176 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:06.110651 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-fce46dac-da88-47ce-a3ce-c40d4c803469 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lazy-loading 'flavor' on Instance uuid 0fdf860c-45c6-4d7b-a438-c013db13a81d {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:57:06.454379 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fce46dac-da88-47ce-a3ce-c40d4c803469 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "POST /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/action" status: 202 len: 0 microversion: 2.20 time: 0.425615 Jul 19 20:57:06.456090 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 349/730] 10.222.0.70 () {62 vars in 1318 bytes} [Tue Jul 19 20:57:06 2022] POST /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:57:06.469095 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b67afb53-3bbd-4a1c-be7b-a78453abf0ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:06.471517 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b67afb53-3bbd-4a1c-be7b-a78453abf0ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:06.479479 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b67afb53-3bbd-4a1c-be7b-a78453abf0ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:06.480229 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b67afb53-3bbd-4a1c-be7b-a78453abf0ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:06.481280 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b67afb53-3bbd-4a1c-be7b-a78453abf0ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:06.482161 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b67afb53-3bbd-4a1c-be7b-a78453abf0ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:06.658035 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b67afb53-3bbd-4a1c-be7b-a78453abf0ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:06.668828 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b67afb53-3bbd-4a1c-be7b-a78453abf0ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:06.670462 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b67afb53-3bbd-4a1c-be7b-a78453abf0ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:06.672061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b67afb53-3bbd-4a1c-be7b-a78453abf0ea tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.211396 Jul 19 20:57:06.672893 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 382/731] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:06 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:06.733813 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fdc818a9-082d-4d1c-aeea-c3af48f68b29 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-381350778"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:06.734445 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-fdc818a9-082d-4d1c-aeea-c3af48f68b29 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:06.742159 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fdc818a9-082d-4d1c-aeea-c3af48f68b29 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:06.742610 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fdc818a9-082d-4d1c-aeea-c3af48f68b29 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:06.743394 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fdc818a9-082d-4d1c-aeea-c3af48f68b29 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:06.743837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fdc818a9-082d-4d1c-aeea-c3af48f68b29 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:06.876260 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.network.security_group_api [None req-fdc818a9-082d-4d1c-aeea-c3af48f68b29 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Adding security group fd78f80b-f43c-453c-b8bb-7d3954de87d1 to port 1ccc96a0-961a-4491-b458-91a6ced6d896 Jul 19 20:57:07.316341 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fdc818a9-082d-4d1c-aeea-c3af48f68b29 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "POST /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/action" status: 202 len: 0 microversion: 2.1 time: 0.586128 Jul 19 20:57:07.319392 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 350/732] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 20:57:06 2022] POST /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:57:07.337090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-398c5d09-ea50-449e-9ff6-71bba6d119fd req-5919db1b-a065-4de4-b44b-17ffeb551336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebc1845-f1c0-4b88-b056-045377c6ef1c", "tag": "1ccc96a0-961a-4491-b458-91a6ced6d896"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:07.344514 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a80c414b-97c2-4737-a2c1-329c0d760523 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:07.345531 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a80c414b-97c2-4737-a2c1-329c0d760523 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:07.353087 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-398c5d09-ea50-449e-9ff6-71bba6d119fd req-5919db1b-a065-4de4-b44b-17ffeb551336 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:07.354604 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-398c5d09-ea50-449e-9ff6-71bba6d119fd req-5919db1b-a065-4de4-b44b-17ffeb551336 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:07.357658 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a80c414b-97c2-4737-a2c1-329c0d760523 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:07.358076 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a80c414b-97c2-4737-a2c1-329c0d760523 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:07.362728 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a80c414b-97c2-4737-a2c1-329c0d760523 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:07.363193 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a80c414b-97c2-4737-a2c1-329c0d760523 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:07.380154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-398c5d09-ea50-449e-9ff6-71bba6d119fd req-5919db1b-a065-4de4-b44b-17ffeb551336 service nova] Creating event network-changed:1ccc96a0-961a-4491-b458-91a6ced6d896 for instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c on hv-cinder-79987 Jul 19 20:57:07.388569 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-398c5d09-ea50-449e-9ff6-71bba6d119fd req-5919db1b-a065-4de4-b44b-17ffeb551336 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061432 Jul 19 20:57:07.390498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 383/733] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:07.597400 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a80c414b-97c2-4737-a2c1-329c0d760523 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:07.608372 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a80c414b-97c2-4737-a2c1-329c0d760523 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1758 microversion: 2.1 time: 0.278372 Jul 19 20:57:07.609464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 351/734] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:07 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1758 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:07.692820 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c20cd6cc-edc6-403b-b0ef-720376ca9b91 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:07.694402 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c20cd6cc-edc6-403b-b0ef-720376ca9b91 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:07.701184 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c20cd6cc-edc6-403b-b0ef-720376ca9b91 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:07.701745 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c20cd6cc-edc6-403b-b0ef-720376ca9b91 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:07.702580 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c20cd6cc-edc6-403b-b0ef-720376ca9b91 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:07.703084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c20cd6cc-edc6-403b-b0ef-720376ca9b91 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:07.901686 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c20cd6cc-edc6-403b-b0ef-720376ca9b91 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:07.913641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c20cd6cc-edc6-403b-b0ef-720376ca9b91 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:07.915411 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c20cd6cc-edc6-403b-b0ef-720376ca9b91 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:07.918824 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c20cd6cc-edc6-403b-b0ef-720376ca9b91 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.231050 Jul 19 20:57:07.929410 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 384/735] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:07 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:08.938836 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7bab7d23-a3c3-4014-a873-f9f5c72fc520 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:08.939515 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7bab7d23-a3c3-4014-a873-f9f5c72fc520 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:08.946746 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7bab7d23-a3c3-4014-a873-f9f5c72fc520 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:08.947207 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7bab7d23-a3c3-4014-a873-f9f5c72fc520 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:08.947991 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7bab7d23-a3c3-4014-a873-f9f5c72fc520 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:08.948432 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7bab7d23-a3c3-4014-a873-f9f5c72fc520 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:09.086010 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7bab7d23-a3c3-4014-a873-f9f5c72fc520 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:09.094313 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7bab7d23-a3c3-4014-a873-f9f5c72fc520 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:09.096344 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7bab7d23-a3c3-4014-a873-f9f5c72fc520 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:09.097537 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7bab7d23-a3c3-4014-a873-f9f5c72fc520 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.162582 Jul 19 20:57:09.098092 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 352/736] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:08 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:10.116656 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-390986c7-d0c6-4b42-9ce0-a74e3ff41103 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:10.117271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-390986c7-d0c6-4b42-9ce0-a74e3ff41103 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:10.123944 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-390986c7-d0c6-4b42-9ce0-a74e3ff41103 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:10.124476 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-390986c7-d0c6-4b42-9ce0-a74e3ff41103 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:10.125271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-390986c7-d0c6-4b42-9ce0-a74e3ff41103 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:10.125745 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-390986c7-d0c6-4b42-9ce0-a74e3ff41103 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:10.130590 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0ed993b7-165b-4a0e-919d-dcca1835bf0e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64af7ecf-f6ac-4493-a0d0-5d8074d007b7"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:10.131705 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0ed993b7-165b-4a0e-919d-dcca1835bf0e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:10.138392 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ed993b7-165b-4a0e-919d-dcca1835bf0e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:10.139164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ed993b7-165b-4a0e-919d-dcca1835bf0e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:10.139622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ed993b7-165b-4a0e-919d-dcca1835bf0e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:10.140059 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ed993b7-165b-4a0e-919d-dcca1835bf0e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:10.219371 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-0ed993b7-165b-4a0e-919d-dcca1835bf0e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Invalid volume: volume 64af7ecf-f6ac-4493-a0d0-5d8074d007b7 is already attached to instances: a0154001-450f-477f-a952-a769ea371c70 Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0ed993b7-165b-4a0e-919d-dcca1835bf0e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: POST /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-volume_attachments HTTP/1.1 Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 74 Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:57:10.221088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:57:10.222679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:57:10.222679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:57:10.222679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:57:10.222679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:57:10.222679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:57:10.222679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:57:10.222679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:57:10.222679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:57:10.222679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:57:10.222679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Jul 19 20:57:10.222679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {"volumeAttachment": {"volumeId": "64af7ecf-f6ac-4493-a0d0-5d8074d007b7"}} Jul 19 20:57:10.222679 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Invalid volume: volume 64af7ecf-f6ac-4493-a0d0-5d8074d007b7 is already attached to instances: a0154001-450f-477f-a952-a769ea371c70 Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'server_id': 'a0154001-450f-477f-a952-a769ea371c70', 'body': {'volumeAttachment': {'volumeId': '64af7ecf-f6ac-4493-a0d0-5d8074d007b7'}}} Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 64af7ecf-f6ac-4493-a0d0-5d8074d007b7 is already attached to instances: a0154001-450f-477f-a952-a769ea371c70 Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:57:10.223918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 64af7ecf-f6ac-4493-a0d0-5d8074d007b7 is already attached to instances: a0154001-450f-477f-a952-a769ea371c70 Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:10.225205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:10.227172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:10.227172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:57:10.227172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:57:10.227172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 64af7ecf-f6ac-4493-a0d0-5d8074d007b7 is already attached to instances: a0154001-450f-477f-a952-a769ea371c70 Jul 19 20:57:10.227172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:57:10.227172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0ed993b7-165b-4a0e-919d-dcca1835bf0e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 400 to user: Invalid volume: volume 64af7ecf-f6ac-4493-a0d0-5d8074d007b7 is already attached to instances: a0154001-450f-477f-a952-a769ea371c70 {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:57:10.227172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0ed993b7-165b-4a0e-919d-dcca1835bf0e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097088 Jul 19 20:57:10.227172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 353/737] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 20:57:10 2022] POST /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:57:10.258533 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-390986c7-d0c6-4b42-9ce0-a74e3ff41103 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:10.266619 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-390986c7-d0c6-4b42-9ce0-a74e3ff41103 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:10.268244 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-390986c7-d0c6-4b42-9ce0-a74e3ff41103 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:10.269510 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-390986c7-d0c6-4b42-9ce0-a74e3ff41103 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.156780 Jul 19 20:57:10.270081 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 385/738] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:10 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:10.287457 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-36e5033e-4b10-4a9a-aedd-e5eb54a0af0c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:10.287967 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-36e5033e-4b10-4a9a-aedd-e5eb54a0af0c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:10.294256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-36e5033e-4b10-4a9a-aedd-e5eb54a0af0c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:10.294524 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-36e5033e-4b10-4a9a-aedd-e5eb54a0af0c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:10.295278 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-36e5033e-4b10-4a9a-aedd-e5eb54a0af0c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:10.295709 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-36e5033e-4b10-4a9a-aedd-e5eb54a0af0c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:10.374813 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-36e5033e-4b10-4a9a-aedd-e5eb54a0af0c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lazy-loading 'services' on Instance uuid a0154001-450f-477f-a952-a769ea371c70 {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:57:10.447809 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-36e5033e-4b10-4a9a-aedd-e5eb54a0af0c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-volume_attachments/64af7ecf-f6ac-4493-a0d0-5d8074d007b7" status: 202 len: 0 microversion: 2.1 time: 0.163993 Jul 19 20:57:10.448392 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 354/739] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jul 19 20:57:10 2022] DELETE /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-volume_attachments/64af7ecf-f6ac-4493-a0d0-5d8074d007b7 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:57:10.456913 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3ef12090-ca52-4d1b-ad83-a5ae78569813 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:10.457894 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3ef12090-ca52-4d1b-ad83-a5ae78569813 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:10.464154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ef12090-ca52-4d1b-ad83-a5ae78569813 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:10.464584 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ef12090-ca52-4d1b-ad83-a5ae78569813 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:10.465833 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ef12090-ca52-4d1b-ad83-a5ae78569813 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:10.466233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ef12090-ca52-4d1b-ad83-a5ae78569813 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:10.498177 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3ef12090-ca52-4d1b-ad83-a5ae78569813 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045180 Jul 19 20:57:10.498742 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 386/740] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:57:10 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:57:11.290294 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-751bfd3b-b127-49f6-9ece-92f2ceb9f8a5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:11.292074 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-751bfd3b-b127-49f6-9ece-92f2ceb9f8a5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:11.300894 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-751bfd3b-b127-49f6-9ece-92f2ceb9f8a5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:11.301349 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-751bfd3b-b127-49f6-9ece-92f2ceb9f8a5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:11.302094 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-751bfd3b-b127-49f6-9ece-92f2ceb9f8a5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:11.302538 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-751bfd3b-b127-49f6-9ece-92f2ceb9f8a5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:11.437866 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-751bfd3b-b127-49f6-9ece-92f2ceb9f8a5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:11.448892 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-751bfd3b-b127-49f6-9ece-92f2ceb9f8a5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:11.450434 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-751bfd3b-b127-49f6-9ece-92f2ceb9f8a5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:11.451600 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-751bfd3b-b127-49f6-9ece-92f2ceb9f8a5 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.166137 Jul 19 20:57:11.452152 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 355/741] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:11 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:11.510189 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9d4503fb-430f-461e-8b30-e220a458f4f8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:11.511234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-9d4503fb-430f-461e-8b30-e220a458f4f8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:11.518386 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9d4503fb-430f-461e-8b30-e220a458f4f8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:11.518838 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9d4503fb-430f-461e-8b30-e220a458f4f8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:11.519588 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9d4503fb-430f-461e-8b30-e220a458f4f8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:11.520017 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9d4503fb-430f-461e-8b30-e220a458f4f8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:11.548940 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9d4503fb-430f-461e-8b30-e220a458f4f8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042660 Jul 19 20:57:11.549522 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 387/742] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:57:11 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:57:11.606323 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-85532f9e-3ec1-4c78-9de5-bb8489ff4091 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:11.606817 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-85532f9e-3ec1-4c78-9de5-bb8489ff4091 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:11.613220 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-85532f9e-3ec1-4c78-9de5-bb8489ff4091 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:11.613702 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-85532f9e-3ec1-4c78-9de5-bb8489ff4091 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:11.614467 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-85532f9e-3ec1-4c78-9de5-bb8489ff4091 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:11.614905 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-85532f9e-3ec1-4c78-9de5-bb8489ff4091 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:11.639832 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-85532f9e-3ec1-4c78-9de5-bb8489ff4091 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:57:11.712022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-85532f9e-3ec1-4c78-9de5-bb8489ff4091 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 204 len: 0 microversion: 2.1 time: 0.109376 Jul 19 20:57:11.712602 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 356/743] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:57:11 2022] DELETE /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:57:11.721872 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0812eb97-8532-464d-bb4e-ef4d14186ce6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:11.722581 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0812eb97-8532-464d-bb4e-ef4d14186ce6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:11.728964 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0812eb97-8532-464d-bb4e-ef4d14186ce6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:11.729454 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0812eb97-8532-464d-bb4e-ef4d14186ce6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:11.730235 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0812eb97-8532-464d-bb4e-ef4d14186ce6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:11.730700 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0812eb97-8532-464d-bb4e-ef4d14186ce6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:11.861627 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0812eb97-8532-464d-bb4e-ef4d14186ce6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:11.868958 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0812eb97-8532-464d-bb4e-ef4d14186ce6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1683 microversion: 2.1 time: 0.151761 Jul 19 20:57:11.869540 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 388/744] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:11 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:12.471140 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-3919bb6d-6ee9-4e3e-b8a5-7dd269081451 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:12.471843 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-3919bb6d-6ee9-4e3e-b8a5-7dd269081451 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:12.478614 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3919bb6d-6ee9-4e3e-b8a5-7dd269081451 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:12.479067 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3919bb6d-6ee9-4e3e-b8a5-7dd269081451 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:12.479836 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3919bb6d-6ee9-4e3e-b8a5-7dd269081451 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:12.480280 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3919bb6d-6ee9-4e3e-b8a5-7dd269081451 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:12.613663 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3919bb6d-6ee9-4e3e-b8a5-7dd269081451 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:12.621855 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3919bb6d-6ee9-4e3e-b8a5-7dd269081451 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:12.623388 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3919bb6d-6ee9-4e3e-b8a5-7dd269081451 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:12.624550 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-3919bb6d-6ee9-4e3e-b8a5-7dd269081451 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.157849 Jul 19 20:57:12.625170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 357/745] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:12 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:12.886813 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d1b5c38e-80ef-4dcc-9b40-26ee88974a90 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:12.887356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d1b5c38e-80ef-4dcc-9b40-26ee88974a90 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:12.894149 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d1b5c38e-80ef-4dcc-9b40-26ee88974a90 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:12.894605 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d1b5c38e-80ef-4dcc-9b40-26ee88974a90 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:12.895380 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d1b5c38e-80ef-4dcc-9b40-26ee88974a90 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:12.895825 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d1b5c38e-80ef-4dcc-9b40-26ee88974a90 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:13.029992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d1b5c38e-80ef-4dcc-9b40-26ee88974a90 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:13.038145 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d1b5c38e-80ef-4dcc-9b40-26ee88974a90 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1683 microversion: 2.1 time: 0.155267 Jul 19 20:57:13.039321 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 389/746] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:12 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:13.643874 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f4d37780-404b-4ab5-8669-04974d09e949 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:13.644429 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f4d37780-404b-4ab5-8669-04974d09e949 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:13.647022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:13.652362 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f4d37780-404b-4ab5-8669-04974d09e949 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:13.652912 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f4d37780-404b-4ab5-8669-04974d09e949 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:13.653727 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f4d37780-404b-4ab5-8669-04974d09e949 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:13.654159 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f4d37780-404b-4ab5-8669-04974d09e949 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:13.784175 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f4d37780-404b-4ab5-8669-04974d09e949 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:13.792227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f4d37780-404b-4ab5-8669-04974d09e949 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:13.793908 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f4d37780-404b-4ab5-8669-04974d09e949 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:13.795008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f4d37780-404b-4ab5-8669-04974d09e949 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.155689 Jul 19 20:57:13.795560 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 358/747] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:13 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:14.056023 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-60ee5ef0-1501-436f-8546-79ac72983065 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:14.056677 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-60ee5ef0-1501-436f-8546-79ac72983065 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:14.059197 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=44 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:14.064725 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-60ee5ef0-1501-436f-8546-79ac72983065 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:14.065170 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-60ee5ef0-1501-436f-8546-79ac72983065 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:14.065959 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-60ee5ef0-1501-436f-8546-79ac72983065 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:14.066390 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-60ee5ef0-1501-436f-8546-79ac72983065 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:14.202975 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-60ee5ef0-1501-436f-8546-79ac72983065 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:14.210985 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-60ee5ef0-1501-436f-8546-79ac72983065 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1683 microversion: 2.1 time: 0.158865 Jul 19 20:57:14.211559 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 390/748] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:14 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:14.754701 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-64f78f33-64d6-4ce5-84ef-51cf4ebbbeb5 req-f8e96a01-32b2-4e4c-88bc-f36a95562169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0154001-450f-477f-a952-a769ea371c70", "name": "network-vif-deleted", "tag": "6dfd4f22-87be-433f-bfa4-66f03eca4dd9"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:14.767197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-64f78f33-64d6-4ce5-84ef-51cf4ebbbeb5 req-f8e96a01-32b2-4e4c-88bc-f36a95562169 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:14.767917 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-64f78f33-64d6-4ce5-84ef-51cf4ebbbeb5 req-f8e96a01-32b2-4e4c-88bc-f36a95562169 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:14.781263 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-64f78f33-64d6-4ce5-84ef-51cf4ebbbeb5 req-f8e96a01-32b2-4e4c-88bc-f36a95562169 service nova] Creating event network-vif-deleted:6dfd4f22-87be-433f-bfa4-66f03eca4dd9 for instance a0154001-450f-477f-a952-a769ea371c70 on hv-cinder-79987 Jul 19 20:57:14.787768 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-64f78f33-64d6-4ce5-84ef-51cf4ebbbeb5 req-f8e96a01-32b2-4e4c-88bc-f36a95562169 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041525 Jul 19 20:57:14.788917 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 359/749] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:57:14.813562 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-811e444d-aa84-4103-a2e7-1aae089cf608 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:14.814098 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-811e444d-aa84-4103-a2e7-1aae089cf608 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:14.826530 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-811e444d-aa84-4103-a2e7-1aae089cf608 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:14.827370 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-811e444d-aa84-4103-a2e7-1aae089cf608 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:14.828433 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-811e444d-aa84-4103-a2e7-1aae089cf608 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:14.828869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-811e444d-aa84-4103-a2e7-1aae089cf608 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:14.984312 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-811e444d-aa84-4103-a2e7-1aae089cf608 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:14.994400 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-811e444d-aa84-4103-a2e7-1aae089cf608 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:14.995316 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-811e444d-aa84-4103-a2e7-1aae089cf608 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:14.996556 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-811e444d-aa84-4103-a2e7-1aae089cf608 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.187253 Jul 19 20:57:14.997113 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 391/750] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:14 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:15.230558 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-dc8edd54-83ec-493d-9e68-079b339b7f09 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:15.231300 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-dc8edd54-83ec-493d-9e68-079b339b7f09 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:15.239766 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dc8edd54-83ec-493d-9e68-079b339b7f09 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:15.240231 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dc8edd54-83ec-493d-9e68-079b339b7f09 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:15.241039 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dc8edd54-83ec-493d-9e68-079b339b7f09 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:15.241648 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dc8edd54-83ec-493d-9e68-079b339b7f09 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:15.278240 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dc8edd54-83ec-493d-9e68-079b339b7f09 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:15.278794 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-dc8edd54-83ec-493d-9e68-079b339b7f09 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:15.279476 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-dc8edd54-83ec-493d-9e68-079b339b7f09 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lazy-loading 'fault' on Instance uuid a0154001-450f-477f-a952-a769ea371c70 {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:57:15.324236 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-dc8edd54-83ec-493d-9e68-079b339b7f09 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:15.332280 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-dc8edd54-83ec-493d-9e68-079b339b7f09 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 200 len: 1332 microversion: 2.1 time: 0.106892 Jul 19 20:57:15.332849 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 360/751] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:15 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:16.018224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-42e92bbb-7374-4fbb-a78a-b5089db22e6d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:16.019324 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-42e92bbb-7374-4fbb-a78a-b5089db22e6d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:16.031476 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-42e92bbb-7374-4fbb-a78a-b5089db22e6d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:16.032323 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-42e92bbb-7374-4fbb-a78a-b5089db22e6d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:16.034246 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-42e92bbb-7374-4fbb-a78a-b5089db22e6d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:16.035047 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-42e92bbb-7374-4fbb-a78a-b5089db22e6d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:16.176397 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-42e92bbb-7374-4fbb-a78a-b5089db22e6d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:16.184379 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-42e92bbb-7374-4fbb-a78a-b5089db22e6d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:16.185928 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-42e92bbb-7374-4fbb-a78a-b5089db22e6d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:16.187081 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-42e92bbb-7374-4fbb-a78a-b5089db22e6d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.175701 Jul 19 20:57:16.187641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 392/752] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:16 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:16.349410 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-755f5713-bb09-401d-a86b-8e758a13080b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:16.350055 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-755f5713-bb09-401d-a86b-8e758a13080b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:16.357018 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-755f5713-bb09-401d-a86b-8e758a13080b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:16.357502 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-755f5713-bb09-401d-a86b-8e758a13080b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:16.358277 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-755f5713-bb09-401d-a86b-8e758a13080b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:16.358718 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-755f5713-bb09-401d-a86b-8e758a13080b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:16.372926 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-755f5713-bb09-401d-a86b-8e758a13080b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-755f5713-bb09-401d-a86b-8e758a13080b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 HTTP/1.1 Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:57:16.374668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:57:16.376164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:57:16.376164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:57:16.376164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:57:16.376164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:57:16.376164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:57:16.376164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:57:16.376164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:57:16.376164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:57:16.376164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:57:16.376164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:57:16.376164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:57:16.376164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': 'a0154001-450f-477f-a952-a769ea371c70'} Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:57:16.377646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:57:16.379113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:57:16.380489 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-755f5713-bb09-401d-a86b-8e758a13080b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 404 to user: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:57:16.380489 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-755f5713-bb09-401d-a86b-8e758a13080b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 404 len: 111 microversion: 2.1 time: 0.030458 Jul 19 20:57:16.380489 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 361/753] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:16 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:16.385321 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-cdaed634-c43a-4d52-86e4-a6244c6ba759 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '.version_select at 0x7f2527770f70>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:16.402121 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-cdaed634-c43a-4d52-86e4-a6244c6ba759 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205300838" status: 202 len: 0 microversion: 2.1 time: 0.020555 Jul 19 20:57:16.402674 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 393/754] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jul 19 20:57:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205300838 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:57:17.030630 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-28bce6b4-bb47-4981-89dc-93efcc7bbd28 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: .version_select at 0x7f2527dd8f70>, body: {"keypair": {"name": "tempest-keypair-828957770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID2c5yLF8G1DxkV6brGnuC9RtA11PftwZvOrCqDPRHreeYZ6c1iG0CWoN9vcOnxtKPGo6Of1UVk5LJ4rKQ7141qgtTNdyAd/PD5tweIStHYpAodytA7w2lGQ1Zdj9Od9A=="}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:17.045476 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-28bce6b4-bb47-4981-89dc-93efcc7bbd28 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for project 5da6c42976154440bd0459beb12477f2. Resources: {'key_pairs'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:57:17.050196 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-28bce6b4-bb47-4981-89dc-93efcc7bbd28 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for user af989ff6dc024ff19023e6f633915ec3 and project 5da6c42976154440bd0459beb12477f2. Resources: {'key_pairs'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:57:17.073501 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-28bce6b4-bb47-4981-89dc-93efcc7bbd28 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046724 Jul 19 20:57:17.074103 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 362/755] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jul 19 20:57:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:17.208566 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-789c1dac-2711-4752-a05a-88a5f4d9d691 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:17.209325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-789c1dac-2711-4752-a05a-88a5f4d9d691 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:17.216750 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-789c1dac-2711-4752-a05a-88a5f4d9d691 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:17.217620 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-789c1dac-2711-4752-a05a-88a5f4d9d691 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:17.218437 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-789c1dac-2711-4752-a05a-88a5f4d9d691 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:17.219127 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-789c1dac-2711-4752-a05a-88a5f4d9d691 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:17.376980 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-789c1dac-2711-4752-a05a-88a5f4d9d691 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:17.403648 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-789c1dac-2711-4752-a05a-88a5f4d9d691 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:17.411494 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-789c1dac-2711-4752-a05a-88a5f4d9d691 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:17.412835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-789c1dac-2711-4752-a05a-88a5f4d9d691 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.210088 Jul 19 20:57:17.425037 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 394/756] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:17 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:18.435435 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-baf18426-8b3e-49d1-83aa-ca898776683e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:18.436134 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-baf18426-8b3e-49d1-83aa-ca898776683e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:18.446486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-baf18426-8b3e-49d1-83aa-ca898776683e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:18.447181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-baf18426-8b3e-49d1-83aa-ca898776683e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:18.448402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-baf18426-8b3e-49d1-83aa-ca898776683e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:18.449511 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-baf18426-8b3e-49d1-83aa-ca898776683e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:18.521806 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1911319462", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4988720a-c392-40ae-8d35-c194234e1fb1"}], "security_groups": [{"name": "tempest-securitygroup--1481680559"}], "key_name": "tempest-keypair-828957770", "user_data": "}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:18.633634 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-baf18426-8b3e-49d1-83aa-ca898776683e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:18.637511 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:18.647156 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-baf18426-8b3e-49d1-83aa-ca898776683e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:18.648704 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-baf18426-8b3e-49d1-83aa-ca898776683e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:18.649952 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-baf18426-8b3e-49d1-83aa-ca898776683e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.220999 Jul 19 20:57:18.650512 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 363/757] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:18 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:18.660191 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.network.neutron [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] validate_networks() for [('4988720a-c392-40ae-8d35-c194234e1fb1', None, None, None, None, None)] {{(pid=129866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:57:19.047528 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Flavor limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:57:19.047528 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Image limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:57:19.047528 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Flavor pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:57:19.047528 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Image pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:57:19.047951 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:57:19.057301 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:19.058028 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:19.058832 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:19.059271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:19.077198 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for project 5da6c42976154440bd0459beb12477f2. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:57:19.082338 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Getting quotas for user af989ff6dc024ff19023e6f633915ec3 and project 5da6c42976154440bd0459beb12477f2. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:57:19.094242 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Going to run 1 instances... {{(pid=129866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:57:19.096573 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:57:19.145046 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2a30b1b3-bd93-4ce1-af1a-68018eb0c7b5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.632947 Jul 19 20:57:19.145794 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 395/758] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 20:57:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:57:19.156155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-897775a1-9a64-4b24-b289-29d031bd33dd tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:19.156775 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-897775a1-9a64-4b24-b289-29d031bd33dd tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:19.213042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-897775a1-9a64-4b24-b289-29d031bd33dd tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:19.220353 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-897775a1-9a64-4b24-b289-29d031bd33dd tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1241 microversion: 2.1 time: 0.068045 Jul 19 20:57:19.220994 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 364/759] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:19 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:19.670602 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-277b5dfe-d4fd-4cf2-a2c5-3c15a82d83cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:19.671616 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-277b5dfe-d4fd-4cf2-a2c5-3c15a82d83cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:19.680541 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-277b5dfe-d4fd-4cf2-a2c5-3c15a82d83cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:19.681377 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-277b5dfe-d4fd-4cf2-a2c5-3c15a82d83cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:19.682325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-277b5dfe-d4fd-4cf2-a2c5-3c15a82d83cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:19.682916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-277b5dfe-d4fd-4cf2-a2c5-3c15a82d83cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:19.828504 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-277b5dfe-d4fd-4cf2-a2c5-3c15a82d83cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:19.842597 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-277b5dfe-d4fd-4cf2-a2c5-3c15a82d83cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:19.844886 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-277b5dfe-d4fd-4cf2-a2c5-3c15a82d83cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:19.846973 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-277b5dfe-d4fd-4cf2-a2c5-3c15a82d83cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.181059 Jul 19 20:57:19.847565 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 396/760] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:19 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:20.238545 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-881b5216-4eb4-4116-9720-d097c478e5f0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:20.239152 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-881b5216-4eb4-4116-9720-d097c478e5f0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:20.247660 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-881b5216-4eb4-4116-9720-d097c478e5f0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:20.248090 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-881b5216-4eb4-4116-9720-d097c478e5f0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:20.249141 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-881b5216-4eb4-4116-9720-d097c478e5f0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:20.250041 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-881b5216-4eb4-4116-9720-d097c478e5f0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:20.327190 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-881b5216-4eb4-4116-9720-d097c478e5f0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:20.336116 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-881b5216-4eb4-4116-9720-d097c478e5f0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1311 microversion: 2.1 time: 0.102657 Jul 19 20:57:20.336869 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 365/761] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:20 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:20.865990 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-71f1c7dd-cd7a-4b6c-affc-51a04f60094c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:20.866769 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-71f1c7dd-cd7a-4b6c-affc-51a04f60094c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:20.876194 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71f1c7dd-cd7a-4b6c-affc-51a04f60094c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:20.876194 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71f1c7dd-cd7a-4b6c-affc-51a04f60094c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:20.876683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71f1c7dd-cd7a-4b6c-affc-51a04f60094c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:20.878030 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-71f1c7dd-cd7a-4b6c-affc-51a04f60094c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:21.061204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-71f1c7dd-cd7a-4b6c-affc-51a04f60094c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:21.071149 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-71f1c7dd-cd7a-4b6c-affc-51a04f60094c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:21.073133 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-71f1c7dd-cd7a-4b6c-affc-51a04f60094c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:21.074660 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-71f1c7dd-cd7a-4b6c-affc-51a04f60094c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.212659 Jul 19 20:57:21.075241 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 397/762] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:20 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:21.355057 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8522b9c5-edd9-43a6-9c25-1997b6c854c8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:21.355807 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8522b9c5-edd9-43a6-9c25-1997b6c854c8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:21.363349 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8522b9c5-edd9-43a6-9c25-1997b6c854c8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.363801 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8522b9c5-edd9-43a6-9c25-1997b6c854c8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:21.364581 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8522b9c5-edd9-43a6-9c25-1997b6c854c8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.365024 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8522b9c5-edd9-43a6-9c25-1997b6c854c8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:21.534310 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8522b9c5-edd9-43a6-9c25-1997b6c854c8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:21.542046 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8522b9c5-edd9-43a6-9c25-1997b6c854c8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1367 microversion: 2.1 time: 0.191884 Jul 19 20:57:21.542626 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 366/763] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:21 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:21.777712 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-833cb51e-ccf5-463a-9256-a612f2d17f0b req-ce69dbd1-2f2c-4cb6-9943-a91a5d9c3ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28bbd44-4ddc-470c-83d6-389f4d4697e0", "tag": "07d1592c-6f96-4277-b758-c2adb3515fcf"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:21.790421 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-833cb51e-ccf5-463a-9256-a612f2d17f0b req-ce69dbd1-2f2c-4cb6-9943-a91a5d9c3ee1 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.791135 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-833cb51e-ccf5-463a-9256-a612f2d17f0b req-ce69dbd1-2f2c-4cb6-9943-a91a5d9c3ee1 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:21.810410 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-833cb51e-ccf5-463a-9256-a612f2d17f0b req-ce69dbd1-2f2c-4cb6-9943-a91a5d9c3ee1 service nova] Creating event network-changed:07d1592c-6f96-4277-b758-c2adb3515fcf for instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 on hv-cinder-79987 Jul 19 20:57:21.817004 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-833cb51e-ccf5-463a-9256-a612f2d17f0b req-ce69dbd1-2f2c-4cb6-9943-a91a5d9c3ee1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044193 Jul 19 20:57:21.819686 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 398/764] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:22.097730 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8e8f4967-2b16-4d44-8156-ae8ff709d9f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:22.098886 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8e8f4967-2b16-4d44-8156-ae8ff709d9f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:22.111492 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8e8f4967-2b16-4d44-8156-ae8ff709d9f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:22.112327 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8e8f4967-2b16-4d44-8156-ae8ff709d9f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:22.113790 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8e8f4967-2b16-4d44-8156-ae8ff709d9f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:22.114582 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8e8f4967-2b16-4d44-8156-ae8ff709d9f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:22.459792 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8e8f4967-2b16-4d44-8156-ae8ff709d9f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:22.468611 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8e8f4967-2b16-4d44-8156-ae8ff709d9f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:22.470738 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8e8f4967-2b16-4d44-8156-ae8ff709d9f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:22.471934 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8e8f4967-2b16-4d44-8156-ae8ff709d9f4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.381494 Jul 19 20:57:22.472505 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 367/765] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:22 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:22.561982 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a5c6f725-e73d-4608-b072-c553d08718c5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:22.562687 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a5c6f725-e73d-4608-b072-c553d08718c5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:22.569783 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a5c6f725-e73d-4608-b072-c553d08718c5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:22.570229 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a5c6f725-e73d-4608-b072-c553d08718c5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:22.570994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a5c6f725-e73d-4608-b072-c553d08718c5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:22.571431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a5c6f725-e73d-4608-b072-c553d08718c5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:22.724101 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-a5c6f725-e73d-4608-b072-c553d08718c5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:22.732905 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a5c6f725-e73d-4608-b072-c553d08718c5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1367 microversion: 2.1 time: 0.175338 Jul 19 20:57:22.733530 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 399/766] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:22 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:23.490789 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-22cf4b02-e9de-446c-83f4-95836a72c575 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:23.491397 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-22cf4b02-e9de-446c-83f4-95836a72c575 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:23.498079 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-22cf4b02-e9de-446c-83f4-95836a72c575 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:23.498534 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-22cf4b02-e9de-446c-83f4-95836a72c575 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:23.499300 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-22cf4b02-e9de-446c-83f4-95836a72c575 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:23.499737 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-22cf4b02-e9de-446c-83f4-95836a72c575 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:23.647880 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-22cf4b02-e9de-446c-83f4-95836a72c575 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:23.655941 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-22cf4b02-e9de-446c-83f4-95836a72c575 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:23.657515 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-22cf4b02-e9de-446c-83f4-95836a72c575 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:23.658673 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-22cf4b02-e9de-446c-83f4-95836a72c575 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.172324 Jul 19 20:57:23.659216 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 368/767] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:23 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:23.751956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-49d05a75-5102-40a3-8716-6cbb9404ef44 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:23.752558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-49d05a75-5102-40a3-8716-6cbb9404ef44 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:23.759290 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-49d05a75-5102-40a3-8716-6cbb9404ef44 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:23.759734 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-49d05a75-5102-40a3-8716-6cbb9404ef44 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:23.760505 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-49d05a75-5102-40a3-8716-6cbb9404ef44 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:23.760939 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-49d05a75-5102-40a3-8716-6cbb9404ef44 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:23.898954 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-49d05a75-5102-40a3-8716-6cbb9404ef44 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:23.906391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-49d05a75-5102-40a3-8716-6cbb9404ef44 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1367 microversion: 2.1 time: 0.158986 Jul 19 20:57:23.906950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 400/768] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:23 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:24.676610 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d2cbfc62-209d-4d1c-b55e-fc124ddd5908 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:24.677158 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d2cbfc62-209d-4d1c-b55e-fc124ddd5908 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:24.683569 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2cbfc62-209d-4d1c-b55e-fc124ddd5908 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:24.684015 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2cbfc62-209d-4d1c-b55e-fc124ddd5908 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:24.684769 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2cbfc62-209d-4d1c-b55e-fc124ddd5908 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:24.685199 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2cbfc62-209d-4d1c-b55e-fc124ddd5908 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:24.815538 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d2cbfc62-209d-4d1c-b55e-fc124ddd5908 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:24.823388 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d2cbfc62-209d-4d1c-b55e-fc124ddd5908 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:24.824918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d2cbfc62-209d-4d1c-b55e-fc124ddd5908 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:24.826345 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d2cbfc62-209d-4d1c-b55e-fc124ddd5908 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.154327 Jul 19 20:57:24.826895 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 369/769] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:24 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:24.924612 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4ae8950f-9e35-4085-a5f7-7630e5fe755d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:24.925268 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4ae8950f-9e35-4085-a5f7-7630e5fe755d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:24.934869 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4ae8950f-9e35-4085-a5f7-7630e5fe755d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:24.935557 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4ae8950f-9e35-4085-a5f7-7630e5fe755d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:24.936454 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4ae8950f-9e35-4085-a5f7-7630e5fe755d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:24.936922 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4ae8950f-9e35-4085-a5f7-7630e5fe755d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:24.956818 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=100 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:25.067615 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4ae8950f-9e35-4085-a5f7-7630e5fe755d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:25.075008 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4ae8950f-9e35-4085-a5f7-7630e5fe755d tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1367 microversion: 2.1 time: 0.155293 Jul 19 20:57:25.075572 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 401/770] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:24 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:25.844227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a1ae253a-dff4-4706-a95c-043825f8cb4b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:25.846006 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a1ae253a-dff4-4706-a95c-043825f8cb4b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:25.853227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a1ae253a-dff4-4706-a95c-043825f8cb4b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:25.853743 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a1ae253a-dff4-4706-a95c-043825f8cb4b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:25.854513 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a1ae253a-dff4-4706-a95c-043825f8cb4b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:25.854953 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a1ae253a-dff4-4706-a95c-043825f8cb4b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:25.990668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a1ae253a-dff4-4706-a95c-043825f8cb4b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:25.999993 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a1ae253a-dff4-4706-a95c-043825f8cb4b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:26.001556 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a1ae253a-dff4-4706-a95c-043825f8cb4b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:26.003328 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a1ae253a-dff4-4706-a95c-043825f8cb4b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1746 microversion: 2.20 time: 0.162581 Jul 19 20:57:26.003328 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 370/771] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:25 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:26.092161 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-078ee170-30e6-4436-85c2-696c34a92275 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:26.092830 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-078ee170-30e6-4436-85c2-696c34a92275 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:26.100198 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-078ee170-30e6-4436-85c2-696c34a92275 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:26.100644 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-078ee170-30e6-4436-85c2-696c34a92275 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:26.101445 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-078ee170-30e6-4436-85c2-696c34a92275 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:26.102140 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-078ee170-30e6-4436-85c2-696c34a92275 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:26.240050 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-078ee170-30e6-4436-85c2-696c34a92275 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:26.247388 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-078ee170-30e6-4436-85c2-696c34a92275 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1367 microversion: 2.1 time: 0.159276 Jul 19 20:57:26.247952 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 402/772] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:26 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:27.022762 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-aa018cff-5074-40cb-9146-1335420be149 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:27.023414 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-aa018cff-5074-40cb-9146-1335420be149 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:27.031886 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-aa018cff-5074-40cb-9146-1335420be149 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:27.032354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-aa018cff-5074-40cb-9146-1335420be149 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:27.033152 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-aa018cff-5074-40cb-9146-1335420be149 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:27.033691 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-aa018cff-5074-40cb-9146-1335420be149 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:27.171257 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-aa018cff-5074-40cb-9146-1335420be149 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:27.181772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-aa018cff-5074-40cb-9146-1335420be149 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:27.183270 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-aa018cff-5074-40cb-9146-1335420be149 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:27.184557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-aa018cff-5074-40cb-9146-1335420be149 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1746 microversion: 2.20 time: 0.165897 Jul 19 20:57:27.185489 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 371/773] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:27 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:27.264435 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-90eed280-aaa0-49f6-a072-0895ac75d199 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:27.265049 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-90eed280-aaa0-49f6-a072-0895ac75d199 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:27.272211 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-90eed280-aaa0-49f6-a072-0895ac75d199 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:27.272661 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-90eed280-aaa0-49f6-a072-0895ac75d199 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:27.273553 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-90eed280-aaa0-49f6-a072-0895ac75d199 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:27.274149 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-90eed280-aaa0-49f6-a072-0895ac75d199 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:27.409667 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-90eed280-aaa0-49f6-a072-0895ac75d199 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:27.417076 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-90eed280-aaa0-49f6-a072-0895ac75d199 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1367 microversion: 2.1 time: 0.156921 Jul 19 20:57:27.417668 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 403/774] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:27 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:28.204069 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0e530695-08ec-490e-b2e6-0f3af7db457c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:28.204684 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0e530695-08ec-490e-b2e6-0f3af7db457c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:28.211140 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0e530695-08ec-490e-b2e6-0f3af7db457c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:28.211592 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0e530695-08ec-490e-b2e6-0f3af7db457c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:28.212411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0e530695-08ec-490e-b2e6-0f3af7db457c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:28.212859 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0e530695-08ec-490e-b2e6-0f3af7db457c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:28.357185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0e530695-08ec-490e-b2e6-0f3af7db457c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:28.366516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0e530695-08ec-490e-b2e6-0f3af7db457c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:28.368059 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0e530695-08ec-490e-b2e6-0f3af7db457c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:28.369272 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0e530695-08ec-490e-b2e6-0f3af7db457c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1746 microversion: 2.20 time: 0.169678 Jul 19 20:57:28.370545 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 372/775] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:28 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:28.438620 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f168c6a3-3557-4bd5-9505-11a7e27a19e1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:28.439748 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f168c6a3-3557-4bd5-9505-11a7e27a19e1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:28.451016 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f168c6a3-3557-4bd5-9505-11a7e27a19e1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:28.451851 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f168c6a3-3557-4bd5-9505-11a7e27a19e1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:28.453421 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f168c6a3-3557-4bd5-9505-11a7e27a19e1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:28.454761 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f168c6a3-3557-4bd5-9505-11a7e27a19e1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:28.599697 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f168c6a3-3557-4bd5-9505-11a7e27a19e1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:28.607620 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f168c6a3-3557-4bd5-9505-11a7e27a19e1 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1367 microversion: 2.1 time: 0.176501 Jul 19 20:57:28.608184 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 404/776] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:28 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:29.389190 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-511df6d0-af53-47d7-948f-acf85e833cb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:29.389904 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-511df6d0-af53-47d7-948f-acf85e833cb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:29.392374 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=6 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:29.398320 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-511df6d0-af53-47d7-948f-acf85e833cb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.398791 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-511df6d0-af53-47d7-948f-acf85e833cb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.399542 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-511df6d0-af53-47d7-948f-acf85e833cb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.399976 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-511df6d0-af53-47d7-948f-acf85e833cb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.539991 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:29.541975 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=6 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:29.547387 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-6a45b529-2fff-427d-9428-a61212ea9eea req-1f51aebc-b0ed-404e-aad0-77fd13a59ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdf860c-45c6-4d7b-a438-c013db13a81d", "name": "network-vif-plugged", "status": "completed", "tag": "04ab7a63-4e2e-47fd-9f11-50e01794d069"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:29.559291 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-6a45b529-2fff-427d-9428-a61212ea9eea req-1f51aebc-b0ed-404e-aad0-77fd13a59ede service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.559740 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-6a45b529-2fff-427d-9428-a61212ea9eea req-1f51aebc-b0ed-404e-aad0-77fd13a59ede service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.578756 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-6a45b529-2fff-427d-9428-a61212ea9eea req-1f51aebc-b0ed-404e-aad0-77fd13a59ede service nova] Creating event network-vif-plugged:04ab7a63-4e2e-47fd-9f11-50e01794d069 for instance 0fdf860c-45c6-4d7b-a438-c013db13a81d on hv-cinder-79987 Jul 19 20:57:29.587192 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-6a45b529-2fff-427d-9428-a61212ea9eea req-1f51aebc-b0ed-404e-aad0-77fd13a59ede service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047069 Jul 19 20:57:29.587834 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-511df6d0-af53-47d7-948f-acf85e833cb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:29.588673 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 405/777] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:29.604381 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-511df6d0-af53-47d7-948f-acf85e833cb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:29.607249 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-511df6d0-af53-47d7-948f-acf85e833cb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:29.609466 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-511df6d0-af53-47d7-948f-acf85e833cb2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1746 microversion: 2.20 time: 0.224635 Jul 19 20:57:29.611194 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 373/778] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:29 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1746 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:29.626391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2dace9a6-ffec-4f7a-ac5a-71096d96f4d5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:29.627426 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2dace9a6-ffec-4f7a-ac5a-71096d96f4d5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:29.634624 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2dace9a6-ffec-4f7a-ac5a-71096d96f4d5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.635117 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2dace9a6-ffec-4f7a-ac5a-71096d96f4d5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.635940 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2dace9a6-ffec-4f7a-ac5a-71096d96f4d5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.636444 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2dace9a6-ffec-4f7a-ac5a-71096d96f4d5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.795120 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2dace9a6-ffec-4f7a-ac5a-71096d96f4d5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:29.803992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2dace9a6-ffec-4f7a-ac5a-71096d96f4d5 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1367 microversion: 2.1 time: 0.183169 Jul 19 20:57:29.804983 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 406/779] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:29 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:30.632943 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5905c4df-df9d-448d-a528-122ed151fe8a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:30.633622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5905c4df-df9d-448d-a528-122ed151fe8a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:30.640860 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5905c4df-df9d-448d-a528-122ed151fe8a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:30.641848 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5905c4df-df9d-448d-a528-122ed151fe8a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:30.642643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5905c4df-df9d-448d-a528-122ed151fe8a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:30.643088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5905c4df-df9d-448d-a528-122ed151fe8a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:30.791443 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5905c4df-df9d-448d-a528-122ed151fe8a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:30.800211 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5905c4df-df9d-448d-a528-122ed151fe8a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:30.801749 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5905c4df-df9d-448d-a528-122ed151fe8a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:30.802932 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5905c4df-df9d-448d-a528-122ed151fe8a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1746 microversion: 2.20 time: 0.174248 Jul 19 20:57:30.803638 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 374/780] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:30 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1746 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:30.827463 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-62704b8c-1443-4512-9aa0-4304341cad29 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:30.828089 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-62704b8c-1443-4512-9aa0-4304341cad29 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:30.837299 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-62704b8c-1443-4512-9aa0-4304341cad29 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:30.837888 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-62704b8c-1443-4512-9aa0-4304341cad29 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:30.838796 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-62704b8c-1443-4512-9aa0-4304341cad29 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:30.839493 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-62704b8c-1443-4512-9aa0-4304341cad29 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:30.977993 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-62704b8c-1443-4512-9aa0-4304341cad29 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:30.986687 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-62704b8c-1443-4512-9aa0-4304341cad29 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1367 microversion: 2.1 time: 0.169626 Jul 19 20:57:30.987273 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 407/781] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:30 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:31.606436 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-2d174d3d-9f90-4d3b-9e1e-f67a4bc7a9e6 req-a185a54c-030e-42d4-9b07-1bd5112a2ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28bbd44-4ddc-470c-83d6-389f4d4697e0", "name": "network-vif-plugged", "status": "completed", "tag": "07d1592c-6f96-4277-b758-c2adb3515fcf"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:31.615619 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-2d174d3d-9f90-4d3b-9e1e-f67a4bc7a9e6 req-a185a54c-030e-42d4-9b07-1bd5112a2ab4 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:31.616058 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-2d174d3d-9f90-4d3b-9e1e-f67a4bc7a9e6 req-a185a54c-030e-42d4-9b07-1bd5112a2ab4 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:31.627422 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-2d174d3d-9f90-4d3b-9e1e-f67a4bc7a9e6 req-a185a54c-030e-42d4-9b07-1bd5112a2ab4 service nova] Creating event network-vif-plugged:07d1592c-6f96-4277-b758-c2adb3515fcf for instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 on hv-cinder-79987 Jul 19 20:57:31.632462 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-2d174d3d-9f90-4d3b-9e1e-f67a4bc7a9e6 req-a185a54c-030e-42d4-9b07-1bd5112a2ab4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029697 Jul 19 20:57:31.633131 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 375/782] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:57:31.823253 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-939e454c-142e-409f-979f-24b700645d76 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:31.823888 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-939e454c-142e-409f-979f-24b700645d76 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:31.830184 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-939e454c-142e-409f-979f-24b700645d76 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:31.830855 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-939e454c-142e-409f-979f-24b700645d76 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:31.831390 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-939e454c-142e-409f-979f-24b700645d76 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:31.831839 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-939e454c-142e-409f-979f-24b700645d76 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:31.976042 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-939e454c-142e-409f-979f-24b700645d76 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:31.984495 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-939e454c-142e-409f-979f-24b700645d76 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:31.986106 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-939e454c-142e-409f-979f-24b700645d76 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:31.987295 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-939e454c-142e-409f-979f-24b700645d76 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1746 microversion: 2.20 time: 0.168529 Jul 19 20:57:31.987871 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 408/783] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:31 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:32.004323 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-47a2de9d-251d-45d5-8e82-62ea7f2a4522 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:32.005126 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-47a2de9d-251d-45d5-8e82-62ea7f2a4522 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:32.011887 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-47a2de9d-251d-45d5-8e82-62ea7f2a4522 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:32.012441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-47a2de9d-251d-45d5-8e82-62ea7f2a4522 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:32.013234 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-47a2de9d-251d-45d5-8e82-62ea7f2a4522 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:32.013700 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-47a2de9d-251d-45d5-8e82-62ea7f2a4522 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:32.154413 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-47a2de9d-251d-45d5-8e82-62ea7f2a4522 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:32.163714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-47a2de9d-251d-45d5-8e82-62ea7f2a4522 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1367 microversion: 2.1 time: 0.164016 Jul 19 20:57:32.164348 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 376/784] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:31 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:33.006314 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dc3373e6-2b96-484f-95fc-057d0d84cace tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:33.006847 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-dc3373e6-2b96-484f-95fc-057d0d84cace tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:33.013473 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dc3373e6-2b96-484f-95fc-057d0d84cace tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:33.013923 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dc3373e6-2b96-484f-95fc-057d0d84cace tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:33.014690 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dc3373e6-2b96-484f-95fc-057d0d84cace tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:33.015115 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dc3373e6-2b96-484f-95fc-057d0d84cace tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:33.153331 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dc3373e6-2b96-484f-95fc-057d0d84cace tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:33.166549 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dc3373e6-2b96-484f-95fc-057d0d84cace tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:33.168398 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dc3373e6-2b96-484f-95fc-057d0d84cace tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:33.169647 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dc3373e6-2b96-484f-95fc-057d0d84cace tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1746 microversion: 2.20 time: 0.167325 Jul 19 20:57:33.170328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 409/785] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:33 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:33.179961 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c6a79e50-bf38-4cd4-a4d4-b82438dd96a4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:33.180712 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c6a79e50-bf38-4cd4-a4d4-b82438dd96a4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:33.187752 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c6a79e50-bf38-4cd4-a4d4-b82438dd96a4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:33.188741 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c6a79e50-bf38-4cd4-a4d4-b82438dd96a4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:33.189682 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c6a79e50-bf38-4cd4-a4d4-b82438dd96a4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:33.190166 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c6a79e50-bf38-4cd4-a4d4-b82438dd96a4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:33.336253 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c6a79e50-bf38-4cd4-a4d4-b82438dd96a4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:33.344027 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c6a79e50-bf38-4cd4-a4d4-b82438dd96a4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1367 microversion: 2.1 time: 0.167859 Jul 19 20:57:33.344689 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 377/786] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:33 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:34.190204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d2908967-5deb-467e-b45a-a73b4938b0be tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:34.190204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d2908967-5deb-467e-b45a-a73b4938b0be tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:34.196950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d2908967-5deb-467e-b45a-a73b4938b0be tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.197421 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d2908967-5deb-467e-b45a-a73b4938b0be tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.199169 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d2908967-5deb-467e-b45a-a73b4938b0be tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.199618 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d2908967-5deb-467e-b45a-a73b4938b0be tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.356378 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d2908967-5deb-467e-b45a-a73b4938b0be tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:34.362035 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9f277e08-bc01-45ca-8216-48658ca832c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:34.362596 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9f277e08-bc01-45ca-8216-48658ca832c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:34.366310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d2908967-5deb-467e-b45a-a73b4938b0be tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:34.369692 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f277e08-bc01-45ca-8216-48658ca832c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.370207 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f277e08-bc01-45ca-8216-48658ca832c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.370994 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f277e08-bc01-45ca-8216-48658ca832c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.371440 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9f277e08-bc01-45ca-8216-48658ca832c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.383071 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d2908967-5deb-467e-b45a-a73b4938b0be tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:34.384652 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d2908967-5deb-467e-b45a-a73b4938b0be tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1741 microversion: 2.20 time: 0.200248 Jul 19 20:57:34.385575 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 410/787] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:34 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:34.594923 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9f277e08-bc01-45ca-8216-48658ca832c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:34.616014 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9f277e08-bc01-45ca-8216-48658ca832c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1557 microversion: 2.1 time: 0.258171 Jul 19 20:57:34.621964 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 378/788] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:34 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1557 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:34.655345 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8f4b0c76-ebb3-4dd3-ad2f-031089aba5ae tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:34.656760 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8f4b0c76-ebb3-4dd3-ad2f-031089aba5ae tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:34.678285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8f4b0c76-ebb3-4dd3-ad2f-031089aba5ae tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.679699 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8f4b0c76-ebb3-4dd3-ad2f-031089aba5ae tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.681181 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8f4b0c76-ebb3-4dd3-ad2f-031089aba5ae tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.681752 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8f4b0c76-ebb3-4dd3-ad2f-031089aba5ae tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.802206 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8f4b0c76-ebb3-4dd3-ad2f-031089aba5ae tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162273 Jul 19 20:57:34.803408 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 411/789] 10.222.0.70 () {58 vars in 1274 bytes} [Tue Jul 19 20:57:34 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:35.412411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-6f56f67d-0289-4dae-b197-452ccb04005c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:35.413951 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-6f56f67d-0289-4dae-b197-452ccb04005c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:35.425309 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6f56f67d-0289-4dae-b197-452ccb04005c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:35.433208 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6f56f67d-0289-4dae-b197-452ccb04005c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:35.434493 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6f56f67d-0289-4dae-b197-452ccb04005c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:35.435164 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6f56f67d-0289-4dae-b197-452ccb04005c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:35.715329 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6f56f67d-0289-4dae-b197-452ccb04005c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:35.757946 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6f56f67d-0289-4dae-b197-452ccb04005c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:35.763655 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6f56f67d-0289-4dae-b197-452ccb04005c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:35.768514 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-6f56f67d-0289-4dae-b197-452ccb04005c tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1741 microversion: 2.20 time: 0.360212 Jul 19 20:57:35.771914 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 379/790] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:35 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1741 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:36.626674 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-586e4054-433b-49ac-bcc1-234efa8bdde9 req-f2c7fd58-ea96-4781-a310-d12cb9c19483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28bbd44-4ddc-470c-83d6-389f4d4697e0", "tag": "07d1592c-6f96-4277-b758-c2adb3515fcf"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:36.635368 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-586e4054-433b-49ac-bcc1-234efa8bdde9 req-f2c7fd58-ea96-4781-a310-d12cb9c19483 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:36.635812 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-586e4054-433b-49ac-bcc1-234efa8bdde9 req-f2c7fd58-ea96-4781-a310-d12cb9c19483 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:36.654703 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-586e4054-433b-49ac-bcc1-234efa8bdde9 req-f2c7fd58-ea96-4781-a310-d12cb9c19483 service nova] Creating event network-changed:07d1592c-6f96-4277-b758-c2adb3515fcf for instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 on hv-cinder-79987 Jul 19 20:57:36.661523 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-586e4054-433b-49ac-bcc1-234efa8bdde9 req-f2c7fd58-ea96-4781-a310-d12cb9c19483 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044950 Jul 19 20:57:36.662341 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 412/791] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:36.793221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ab4d6ce2-5287-4943-9df1-00b8069d99d2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:36.794538 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ab4d6ce2-5287-4943-9df1-00b8069d99d2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:36.810698 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ab4d6ce2-5287-4943-9df1-00b8069d99d2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:36.811154 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ab4d6ce2-5287-4943-9df1-00b8069d99d2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:36.811956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ab4d6ce2-5287-4943-9df1-00b8069d99d2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:36.812406 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ab4d6ce2-5287-4943-9df1-00b8069d99d2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:37.037139 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ab4d6ce2-5287-4943-9df1-00b8069d99d2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:37.055043 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ab4d6ce2-5287-4943-9df1-00b8069d99d2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:37.057613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ab4d6ce2-5287-4943-9df1-00b8069d99d2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:37.061125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ab4d6ce2-5287-4943-9df1-00b8069d99d2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1741 microversion: 2.20 time: 0.271812 Jul 19 20:57:37.063906 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 380/792] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:36 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1741 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:38.090399 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-af2d5606-6c9b-44e2-9470-78226b4d32c1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:38.091281 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-af2d5606-6c9b-44e2-9470-78226b4d32c1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:38.107761 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-af2d5606-6c9b-44e2-9470-78226b4d32c1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:38.109002 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-af2d5606-6c9b-44e2-9470-78226b4d32c1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:38.110933 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-af2d5606-6c9b-44e2-9470-78226b4d32c1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:38.111552 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-af2d5606-6c9b-44e2-9470-78226b4d32c1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:38.328710 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-af2d5606-6c9b-44e2-9470-78226b4d32c1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:38.346072 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-af2d5606-6c9b-44e2-9470-78226b4d32c1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:38.348185 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-af2d5606-6c9b-44e2-9470-78226b4d32c1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:38.349697 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-af2d5606-6c9b-44e2-9470-78226b4d32c1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1741 microversion: 2.20 time: 0.270138 Jul 19 20:57:38.352131 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 413/793] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:38 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1741 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:57:39.373439 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-70ee8d49-eadf-401c-b48c-a02da1e02174 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:39.374972 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-70ee8d49-eadf-401c-b48c-a02da1e02174 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:39.389620 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-70ee8d49-eadf-401c-b48c-a02da1e02174 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:39.390506 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-70ee8d49-eadf-401c-b48c-a02da1e02174 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:39.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-70ee8d49-eadf-401c-b48c-a02da1e02174 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:39.392082 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-70ee8d49-eadf-401c-b48c-a02da1e02174 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:39.605097 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-70ee8d49-eadf-401c-b48c-a02da1e02174 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:39.618878 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-70ee8d49-eadf-401c-b48c-a02da1e02174 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:39.621017 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-70ee8d49-eadf-401c-b48c-a02da1e02174 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:39.622624 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-70ee8d49-eadf-401c-b48c-a02da1e02174 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1741 microversion: 2.20 time: 0.253566 Jul 19 20:57:39.623274 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 381/794] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:39 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1741 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:40.654775 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-79cec863-7351-4ab3-ad03-065c658f31e1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:40.655876 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-79cec863-7351-4ab3-ad03-065c658f31e1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:40.667741 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-79cec863-7351-4ab3-ad03-065c658f31e1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:40.668410 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-79cec863-7351-4ab3-ad03-065c658f31e1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:40.669466 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-79cec863-7351-4ab3-ad03-065c658f31e1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:40.670141 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-79cec863-7351-4ab3-ad03-065c658f31e1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:40.858345 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-79cec863-7351-4ab3-ad03-065c658f31e1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:40.870234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-79cec863-7351-4ab3-ad03-065c658f31e1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:40.873766 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-79cec863-7351-4ab3-ad03-065c658f31e1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:40.875491 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-79cec863-7351-4ab3-ad03-065c658f31e1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1741 microversion: 2.20 time: 0.229851 Jul 19 20:57:40.876397 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 414/795] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:40 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:57:41.895908 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-77bd5876-e57b-4e14-8517-879f3b2a0033 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:41.896613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-77bd5876-e57b-4e14-8517-879f3b2a0033 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:41.903731 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-77bd5876-e57b-4e14-8517-879f3b2a0033 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:41.904192 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-77bd5876-e57b-4e14-8517-879f3b2a0033 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:41.904969 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-77bd5876-e57b-4e14-8517-879f3b2a0033 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:41.905620 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-77bd5876-e57b-4e14-8517-879f3b2a0033 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:41.910324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=100 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:42.073471 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-77bd5876-e57b-4e14-8517-879f3b2a0033 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:42.086901 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-77bd5876-e57b-4e14-8517-879f3b2a0033 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:42.089278 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-77bd5876-e57b-4e14-8517-879f3b2a0033 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:42.090525 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-77bd5876-e57b-4e14-8517-879f3b2a0033 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1741 microversion: 2.20 time: 0.198577 Jul 19 20:57:42.091086 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 382/796] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:41 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:43.119690 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8717828f-60f0-4946-8104-ee599850bb16 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:43.120360 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8717828f-60f0-4946-8104-ee599850bb16 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:43.127372 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8717828f-60f0-4946-8104-ee599850bb16 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:43.127821 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8717828f-60f0-4946-8104-ee599850bb16 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:43.128633 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8717828f-60f0-4946-8104-ee599850bb16 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:43.129105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8717828f-60f0-4946-8104-ee599850bb16 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:43.564493 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-8717828f-60f0-4946-8104-ee599850bb16 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:43.581015 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-8717828f-60f0-4946-8104-ee599850bb16 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:43.586066 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-8717828f-60f0-4946-8104-ee599850bb16 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:43.588415 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8717828f-60f0-4946-8104-ee599850bb16 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1741 microversion: 2.20 time: 0.472300 Jul 19 20:57:43.589902 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 415/797] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:43 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1741 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:44.608178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a6caf160-5fa3-47ff-a742-bcbbf5864bb4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:44.608790 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a6caf160-5fa3-47ff-a742-bcbbf5864bb4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:44.612184 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:44.618401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a6caf160-5fa3-47ff-a742-bcbbf5864bb4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:44.618853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a6caf160-5fa3-47ff-a742-bcbbf5864bb4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:44.619642 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a6caf160-5fa3-47ff-a742-bcbbf5864bb4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:44.620084 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a6caf160-5fa3-47ff-a742-bcbbf5864bb4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:44.773843 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a6caf160-5fa3-47ff-a742-bcbbf5864bb4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:44.783185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a6caf160-5fa3-47ff-a742-bcbbf5864bb4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:44.784689 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a6caf160-5fa3-47ff-a742-bcbbf5864bb4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:44.785882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a6caf160-5fa3-47ff-a742-bcbbf5864bb4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1741 microversion: 2.20 time: 0.182080 Jul 19 20:57:44.786566 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 383/798] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:44 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:45.804202 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5f61e14f-f50b-462c-860d-acf209929dfd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:45.804854 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5f61e14f-f50b-462c-860d-acf209929dfd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:45.808459 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:45.817350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f61e14f-f50b-462c-860d-acf209929dfd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:45.817820 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f61e14f-f50b-462c-860d-acf209929dfd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:45.818603 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f61e14f-f50b-462c-860d-acf209929dfd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:45.819041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f61e14f-f50b-462c-860d-acf209929dfd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:45.965783 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5f61e14f-f50b-462c-860d-acf209929dfd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:45.975126 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5f61e14f-f50b-462c-860d-acf209929dfd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:45.976960 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5f61e14f-f50b-462c-860d-acf209929dfd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:45.978161 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5f61e14f-f50b-462c-860d-acf209929dfd tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1723 microversion: 2.20 time: 0.177879 Jul 19 20:57:45.978943 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 416/799] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:45 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:46.998307 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-3f93c9c0-92b6-4d1b-811b-792dfbda42cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:46.999089 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-3f93c9c0-92b6-4d1b-811b-792dfbda42cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:47.007493 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3f93c9c0-92b6-4d1b-811b-792dfbda42cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:47.007950 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3f93c9c0-92b6-4d1b-811b-792dfbda42cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:47.008736 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3f93c9c0-92b6-4d1b-811b-792dfbda42cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:47.009178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3f93c9c0-92b6-4d1b-811b-792dfbda42cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:47.149951 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3f93c9c0-92b6-4d1b-811b-792dfbda42cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:47.158454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3f93c9c0-92b6-4d1b-811b-792dfbda42cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:47.159982 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3f93c9c0-92b6-4d1b-811b-792dfbda42cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:47.161184 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-3f93c9c0-92b6-4d1b-811b-792dfbda42cc tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1723 microversion: 2.20 time: 0.167629 Jul 19 20:57:47.161794 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 384/800] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:46 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:48.182382 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-bb6392d1-b2ab-468e-8a66-f6d17c84042d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:48.183183 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-bb6392d1-b2ab-468e-8a66-f6d17c84042d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:48.192268 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bb6392d1-b2ab-468e-8a66-f6d17c84042d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.193393 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bb6392d1-b2ab-468e-8a66-f6d17c84042d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.195843 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bb6392d1-b2ab-468e-8a66-f6d17c84042d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.196307 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bb6392d1-b2ab-468e-8a66-f6d17c84042d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.347985 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-bb6392d1-b2ab-468e-8a66-f6d17c84042d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:48.356717 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-bb6392d1-b2ab-468e-8a66-f6d17c84042d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:48.358255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-bb6392d1-b2ab-468e-8a66-f6d17c84042d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:48.359918 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-bb6392d1-b2ab-468e-8a66-f6d17c84042d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1723 microversion: 2.20 time: 0.182046 Jul 19 20:57:48.360474 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 417/801] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:48 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:49.379361 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0a2e0ca2-e2e6-4f5b-ae93-d2ebb0b42b3f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:49.380495 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0a2e0ca2-e2e6-4f5b-ae93-d2ebb0b42b3f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:49.387654 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0a2e0ca2-e2e6-4f5b-ae93-d2ebb0b42b3f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:49.388187 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0a2e0ca2-e2e6-4f5b-ae93-d2ebb0b42b3f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:49.389228 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0a2e0ca2-e2e6-4f5b-ae93-d2ebb0b42b3f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:49.390771 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0a2e0ca2-e2e6-4f5b-ae93-d2ebb0b42b3f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:49.466675 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-72298a69-bdcb-447a-9113-3f1535161c31 req-5a027aed-2975-498d-b255-341d3b5cc183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdf860c-45c6-4d7b-a438-c013db13a81d", "name": "network-vif-unplugged", "status": "completed", "tag": "04ab7a63-4e2e-47fd-9f11-50e01794d069"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:49.481743 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-72298a69-bdcb-447a-9113-3f1535161c31 req-5a027aed-2975-498d-b255-341d3b5cc183 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:49.482811 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-72298a69-bdcb-447a-9113-3f1535161c31 req-5a027aed-2975-498d-b255-341d3b5cc183 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:49.495003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.compute.server_external_events [req-72298a69-bdcb-447a-9113-3f1535161c31 req-5a027aed-2975-498d-b255-341d3b5cc183 service nova] Unable to find a host for instance 0fdf860c-45c6-4d7b-a438-c013db13a81d. Dropping event network-vif-unplugged {{(pid=129866) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 20:57:49.495981 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-72298a69-bdcb-447a-9113-3f1535161c31 req-5a027aed-2975-498d-b255-341d3b5cc183 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034754 Jul 19 20:57:49.497430 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 418/802] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 19 20:57:49.530668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0a2e0ca2-e2e6-4f5b-ae93-d2ebb0b42b3f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:49.538644 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0a2e0ca2-e2e6-4f5b-ae93-d2ebb0b42b3f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:49.540138 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0a2e0ca2-e2e6-4f5b-ae93-d2ebb0b42b3f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:49.541439 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0a2e0ca2-e2e6-4f5b-ae93-d2ebb0b42b3f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1666 microversion: 2.20 time: 0.166108 Jul 19 20:57:49.541991 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 385/803] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:49 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1666 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:49.563585 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-16c1bd3e-9fdd-44b9-9cd8-ca80d4b8fca4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05c00d49-8d78-46f9-a33c-24fd381175c4"}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:49.565451 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-16c1bd3e-9fdd-44b9-9cd8-ca80d4b8fca4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:49.573077 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-16c1bd3e-9fdd-44b9-9cd8-ca80d4b8fca4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:49.573510 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-16c1bd3e-9fdd-44b9-9cd8-ca80d4b8fca4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:49.574295 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-16c1bd3e-9fdd-44b9-9cd8-ca80d4b8fca4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:49.574736 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-16c1bd3e-9fdd-44b9-9cd8-ca80d4b8fca4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:49.747565 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:49.855391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-16c1bd3e-9fdd-44b9-9cd8-ca80d4b8fca4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "POST /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299773 Jul 19 20:57:49.856153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 419/804] 10.222.0.70 () {62 vars in 1363 bytes} [Tue Jul 19 20:57:49 2022] POST /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:57:50.013735 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-cf8336c2-be5c-48a5-bf89-a1a2060d6301 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:50.014248 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-cf8336c2-be5c-48a5-bf89-a1a2060d6301 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:50.022521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cf8336c2-be5c-48a5-bf89-a1a2060d6301 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:50.023664 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cf8336c2-be5c-48a5-bf89-a1a2060d6301 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:50.023867 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cf8336c2-be5c-48a5-bf89-a1a2060d6301 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:50.024222 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cf8336c2-be5c-48a5-bf89-a1a2060d6301 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:50.303171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-cf8336c2-be5c-48a5-bf89-a1a2060d6301 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/os-volume_attachments/05c00d49-8d78-46f9-a33c-24fd381175c4" status: 202 len: 0 microversion: 2.20 time: 0.294795 Jul 19 20:57:50.303762 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 386/805] 10.222.0.70 () {60 vars in 1456 bytes} [Tue Jul 19 20:57:50 2022] DELETE /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/os-volume_attachments/05c00d49-8d78-46f9-a33c-24fd381175c4 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:57:50.363639 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-03fc3c6e-1dfa-4c31-ac8a-09663778ebb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:50.364240 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-03fc3c6e-1dfa-4c31-ac8a-09663778ebb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:50.370497 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-03fc3c6e-1dfa-4c31-ac8a-09663778ebb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:50.370954 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-03fc3c6e-1dfa-4c31-ac8a-09663778ebb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:50.371734 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-03fc3c6e-1dfa-4c31-ac8a-09663778ebb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:50.372176 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-03fc3c6e-1dfa-4c31-ac8a-09663778ebb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:50.464476 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-03fc3c6e-1dfa-4c31-ac8a-09663778ebb1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "POST /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/action" status: 202 len: 0 microversion: 2.20 time: 0.105301 Jul 19 20:57:50.465418 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 420/806] 10.222.0.70 () {62 vars in 1318 bytes} [Tue Jul 19 20:57:50 2022] POST /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:57:50.473590 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-1d7f9d35-dd92-4e24-bc61-3d37e7ffe9d8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:50.474197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-1d7f9d35-dd92-4e24-bc61-3d37e7ffe9d8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:50.481742 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1d7f9d35-dd92-4e24-bc61-3d37e7ffe9d8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:50.482201 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1d7f9d35-dd92-4e24-bc61-3d37e7ffe9d8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:50.482977 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1d7f9d35-dd92-4e24-bc61-3d37e7ffe9d8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:50.483417 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1d7f9d35-dd92-4e24-bc61-3d37e7ffe9d8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:50.622567 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1d7f9d35-dd92-4e24-bc61-3d37e7ffe9d8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:50.631542 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1d7f9d35-dd92-4e24-bc61-3d37e7ffe9d8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:50.633063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1d7f9d35-dd92-4e24-bc61-3d37e7ffe9d8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:50.634354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-1d7f9d35-dd92-4e24-bc61-3d37e7ffe9d8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1674 microversion: 2.20 time: 0.164766 Jul 19 20:57:50.634919 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 387/807] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:50 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:51.653965 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-827bcc4a-9d95-4308-8b4b-604cbe24b55f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:51.654577 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-827bcc4a-9d95-4308-8b4b-604cbe24b55f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:51.661789 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-827bcc4a-9d95-4308-8b4b-604cbe24b55f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:51.662236 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-827bcc4a-9d95-4308-8b4b-604cbe24b55f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:51.663014 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-827bcc4a-9d95-4308-8b4b-604cbe24b55f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:51.663452 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-827bcc4a-9d95-4308-8b4b-604cbe24b55f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:51.807357 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-827bcc4a-9d95-4308-8b4b-604cbe24b55f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:51.816966 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-827bcc4a-9d95-4308-8b4b-604cbe24b55f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:51.818654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-827bcc4a-9d95-4308-8b4b-604cbe24b55f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:51.819936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-827bcc4a-9d95-4308-8b4b-604cbe24b55f tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.170579 Jul 19 20:57:51.820610 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 421/808] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:51 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:52.840258 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-cff1b927-aa6b-442a-9496-b98b7ef34c06 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:52.841143 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-cff1b927-aa6b-442a-9496-b98b7ef34c06 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:52.848494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cff1b927-aa6b-442a-9496-b98b7ef34c06 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:52.848887 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cff1b927-aa6b-442a-9496-b98b7ef34c06 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:52.849661 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cff1b927-aa6b-442a-9496-b98b7ef34c06 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:52.850092 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cff1b927-aa6b-442a-9496-b98b7ef34c06 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:53.006747 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-cff1b927-aa6b-442a-9496-b98b7ef34c06 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:53.016518 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-cff1b927-aa6b-442a-9496-b98b7ef34c06 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:53.018147 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-cff1b927-aa6b-442a-9496-b98b7ef34c06 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:53.019348 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-cff1b927-aa6b-442a-9496-b98b7ef34c06 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.183933 Jul 19 20:57:53.019921 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 388/809] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:52 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:54.037653 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dad6c2b6-f572-42f8-9949-7ff333b94ef7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:54.038261 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-dad6c2b6-f572-42f8-9949-7ff333b94ef7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:54.047320 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dad6c2b6-f572-42f8-9949-7ff333b94ef7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:54.047709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dad6c2b6-f572-42f8-9949-7ff333b94ef7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:54.048792 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dad6c2b6-f572-42f8-9949-7ff333b94ef7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:54.049513 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dad6c2b6-f572-42f8-9949-7ff333b94ef7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:54.203386 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dad6c2b6-f572-42f8-9949-7ff333b94ef7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:54.212199 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dad6c2b6-f572-42f8-9949-7ff333b94ef7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:54.213934 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dad6c2b6-f572-42f8-9949-7ff333b94ef7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:54.215290 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dad6c2b6-f572-42f8-9949-7ff333b94ef7 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.181609 Jul 19 20:57:54.216023 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 422/810] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:54 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:57:55.236043 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2fb5a642-4e4b-4581-8b63-dc4f1d4527fa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:55.236838 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2fb5a642-4e4b-4581-8b63-dc4f1d4527fa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:55.243815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2fb5a642-4e4b-4581-8b63-dc4f1d4527fa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:55.244357 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2fb5a642-4e4b-4581-8b63-dc4f1d4527fa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:55.248628 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2fb5a642-4e4b-4581-8b63-dc4f1d4527fa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:55.248628 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2fb5a642-4e4b-4581-8b63-dc4f1d4527fa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:55.406211 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2fb5a642-4e4b-4581-8b63-dc4f1d4527fa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:55.420256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2fb5a642-4e4b-4581-8b63-dc4f1d4527fa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:55.423409 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2fb5a642-4e4b-4581-8b63-dc4f1d4527fa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:55.425769 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2fb5a642-4e4b-4581-8b63-dc4f1d4527fa tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.194007 Jul 19 20:57:55.426836 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 389/811] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:55 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:57:56.445434 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dce4b65a-d7c3-44f1-aa92-bbcf49153ca0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:56.446081 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-dce4b65a-d7c3-44f1-aa92-bbcf49153ca0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:56.453096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dce4b65a-d7c3-44f1-aa92-bbcf49153ca0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:56.453594 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dce4b65a-d7c3-44f1-aa92-bbcf49153ca0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:56.454435 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dce4b65a-d7c3-44f1-aa92-bbcf49153ca0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:56.455067 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dce4b65a-d7c3-44f1-aa92-bbcf49153ca0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:56.590080 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dce4b65a-d7c3-44f1-aa92-bbcf49153ca0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:56.598765 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dce4b65a-d7c3-44f1-aa92-bbcf49153ca0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:56.600284 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dce4b65a-d7c3-44f1-aa92-bbcf49153ca0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:56.601814 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dce4b65a-d7c3-44f1-aa92-bbcf49153ca0 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.160332 Jul 19 20:57:56.602740 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 423/812] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:56 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:57.621659 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2dfceb41-c5e0-434c-aa81-2c9d14aeebd1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:57.622407 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2dfceb41-c5e0-434c-aa81-2c9d14aeebd1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:57.629671 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2dfceb41-c5e0-434c-aa81-2c9d14aeebd1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:57.630063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2dfceb41-c5e0-434c-aa81-2c9d14aeebd1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:57.630849 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2dfceb41-c5e0-434c-aa81-2c9d14aeebd1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:57.631294 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2dfceb41-c5e0-434c-aa81-2c9d14aeebd1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:57.774926 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2dfceb41-c5e0-434c-aa81-2c9d14aeebd1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:57.783161 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2dfceb41-c5e0-434c-aa81-2c9d14aeebd1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:57.784674 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2dfceb41-c5e0-434c-aa81-2c9d14aeebd1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:57.785953 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2dfceb41-c5e0-434c-aa81-2c9d14aeebd1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.168309 Jul 19 20:57:57.786470 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 390/813] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:57 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:58.804285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-45a8a040-4005-4d1a-a26d-18f1fb49eb09 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:58.804988 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-45a8a040-4005-4d1a-a26d-18f1fb49eb09 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:58.811832 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-45a8a040-4005-4d1a-a26d-18f1fb49eb09 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:58.812277 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-45a8a040-4005-4d1a-a26d-18f1fb49eb09 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:58.813047 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-45a8a040-4005-4d1a-a26d-18f1fb49eb09 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:58.813522 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-45a8a040-4005-4d1a-a26d-18f1fb49eb09 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:58.958579 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-45a8a040-4005-4d1a-a26d-18f1fb49eb09 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:58.967142 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-45a8a040-4005-4d1a-a26d-18f1fb49eb09 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:58.969397 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-45a8a040-4005-4d1a-a26d-18f1fb49eb09 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:58.970842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-45a8a040-4005-4d1a-a26d-18f1fb49eb09 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.170477 Jul 19 20:57:58.971594 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 424/814] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:58 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:57:59.989217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-6e89cdb0-acc3-4440-9d59-13bc44b25120 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:59.990178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-6e89cdb0-acc3-4440-9d59-13bc44b25120 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:59.997070 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6e89cdb0-acc3-4440-9d59-13bc44b25120 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:59.997563 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6e89cdb0-acc3-4440-9d59-13bc44b25120 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:59.998344 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6e89cdb0-acc3-4440-9d59-13bc44b25120 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:59.998787 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6e89cdb0-acc3-4440-9d59-13bc44b25120 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:00.159649 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6e89cdb0-acc3-4440-9d59-13bc44b25120 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:00.168843 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6e89cdb0-acc3-4440-9d59-13bc44b25120 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:00.170490 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6e89cdb0-acc3-4440-9d59-13bc44b25120 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:00.171677 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-6e89cdb0-acc3-4440-9d59-13bc44b25120 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.186434 Jul 19 20:58:00.172244 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 391/815] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:57:59 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:01.191018 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4e7ce2c5-e946-4f42-8412-99091aaa93ab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:01.191839 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4e7ce2c5-e946-4f42-8412-99091aaa93ab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:01.199390 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4e7ce2c5-e946-4f42-8412-99091aaa93ab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:01.199928 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4e7ce2c5-e946-4f42-8412-99091aaa93ab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:01.200765 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4e7ce2c5-e946-4f42-8412-99091aaa93ab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:01.201264 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4e7ce2c5-e946-4f42-8412-99091aaa93ab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:01.339606 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4e7ce2c5-e946-4f42-8412-99091aaa93ab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:01.351695 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4e7ce2c5-e946-4f42-8412-99091aaa93ab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:01.353189 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4e7ce2c5-e946-4f42-8412-99091aaa93ab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:01.354582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4e7ce2c5-e946-4f42-8412-99091aaa93ab tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.167665 Jul 19 20:58:01.362598 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 425/816] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:01 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:02.376036 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-1cc2282a-89a6-45e3-baad-3a96331cd9b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:02.376628 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-1cc2282a-89a6-45e3-baad-3a96331cd9b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:02.386040 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1cc2282a-89a6-45e3-baad-3a96331cd9b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:02.386040 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1cc2282a-89a6-45e3-baad-3a96331cd9b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:02.386569 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1cc2282a-89a6-45e3-baad-3a96331cd9b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:02.387129 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-1cc2282a-89a6-45e3-baad-3a96331cd9b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:02.538070 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1cc2282a-89a6-45e3-baad-3a96331cd9b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:02.547866 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1cc2282a-89a6-45e3-baad-3a96331cd9b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:02.549061 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-1cc2282a-89a6-45e3-baad-3a96331cd9b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:02.550329 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-1cc2282a-89a6-45e3-baad-3a96331cd9b8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.179689 Jul 19 20:58:02.551105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 392/817] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:02 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:03.569045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-1983f170-fd2c-4786-851c-3332c7200045 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:03.569709 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-1983f170-fd2c-4786-851c-3332c7200045 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:03.576435 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1983f170-fd2c-4786-851c-3332c7200045 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:03.576887 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1983f170-fd2c-4786-851c-3332c7200045 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:03.577703 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1983f170-fd2c-4786-851c-3332c7200045 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:03.578283 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1983f170-fd2c-4786-851c-3332c7200045 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:03.709239 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-1983f170-fd2c-4786-851c-3332c7200045 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:03.717640 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-1983f170-fd2c-4786-851c-3332c7200045 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:03.719268 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-1983f170-fd2c-4786-851c-3332c7200045 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:03.720504 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-1983f170-fd2c-4786-851c-3332c7200045 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.155415 Jul 19 20:58:03.721062 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 426/818] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:03 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:04.739716 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f29f3eaf-89ce-4349-9ebd-5c7c701d2a2e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:04.740294 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f29f3eaf-89ce-4349-9ebd-5c7c701d2a2e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:04.746909 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f29f3eaf-89ce-4349-9ebd-5c7c701d2a2e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:04.747363 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f29f3eaf-89ce-4349-9ebd-5c7c701d2a2e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:04.748133 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f29f3eaf-89ce-4349-9ebd-5c7c701d2a2e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:04.748578 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f29f3eaf-89ce-4349-9ebd-5c7c701d2a2e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:04.879597 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f29f3eaf-89ce-4349-9ebd-5c7c701d2a2e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:04.889188 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f29f3eaf-89ce-4349-9ebd-5c7c701d2a2e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:04.891413 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f29f3eaf-89ce-4349-9ebd-5c7c701d2a2e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:04.892600 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f29f3eaf-89ce-4349-9ebd-5c7c701d2a2e tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.156921 Jul 19 20:58:04.893173 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 393/819] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:04 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:05.910932 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2200e671-0bdf-4b48-8cd8-501dd5e071e8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:05.912459 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2200e671-0bdf-4b48-8cd8-501dd5e071e8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:05.919282 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2200e671-0bdf-4b48-8cd8-501dd5e071e8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:05.919733 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2200e671-0bdf-4b48-8cd8-501dd5e071e8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:05.920502 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2200e671-0bdf-4b48-8cd8-501dd5e071e8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:05.920934 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2200e671-0bdf-4b48-8cd8-501dd5e071e8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:06.064638 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2200e671-0bdf-4b48-8cd8-501dd5e071e8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:06.072835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2200e671-0bdf-4b48-8cd8-501dd5e071e8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:06.074364 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2200e671-0bdf-4b48-8cd8-501dd5e071e8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:06.075537 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2200e671-0bdf-4b48-8cd8-501dd5e071e8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.168529 Jul 19 20:58:06.076101 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 427/820] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:05 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:07.093822 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e825f9aa-0777-4e63-a8b5-79083893c726 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:07.094415 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e825f9aa-0777-4e63-a8b5-79083893c726 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:07.101176 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e825f9aa-0777-4e63-a8b5-79083893c726 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:07.101703 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e825f9aa-0777-4e63-a8b5-79083893c726 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:07.102476 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e825f9aa-0777-4e63-a8b5-79083893c726 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:07.102926 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e825f9aa-0777-4e63-a8b5-79083893c726 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:07.235548 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e825f9aa-0777-4e63-a8b5-79083893c726 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:07.244990 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e825f9aa-0777-4e63-a8b5-79083893c726 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:07.246596 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e825f9aa-0777-4e63-a8b5-79083893c726 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:07.247754 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e825f9aa-0777-4e63-a8b5-79083893c726 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.157999 Jul 19 20:58:07.248319 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 394/821] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:07 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:08.266491 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2119dc6c-3ad8-4e79-b83e-a0874349110b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:08.267130 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2119dc6c-3ad8-4e79-b83e-a0874349110b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:08.273620 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2119dc6c-3ad8-4e79-b83e-a0874349110b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:08.274076 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2119dc6c-3ad8-4e79-b83e-a0874349110b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:08.274833 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2119dc6c-3ad8-4e79-b83e-a0874349110b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:08.275273 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2119dc6c-3ad8-4e79-b83e-a0874349110b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:08.411990 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2119dc6c-3ad8-4e79-b83e-a0874349110b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:08.420253 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2119dc6c-3ad8-4e79-b83e-a0874349110b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:08.421901 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2119dc6c-3ad8-4e79-b83e-a0874349110b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:08.424062 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2119dc6c-3ad8-4e79-b83e-a0874349110b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.160589 Jul 19 20:58:08.424062 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 428/822] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:08 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:09.441784 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c7294363-5828-4163-a06e-dd4fa1acb7a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:09.442422 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c7294363-5828-4163-a06e-dd4fa1acb7a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:09.449028 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c7294363-5828-4163-a06e-dd4fa1acb7a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:09.449533 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c7294363-5828-4163-a06e-dd4fa1acb7a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:09.450293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c7294363-5828-4163-a06e-dd4fa1acb7a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:09.450727 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c7294363-5828-4163-a06e-dd4fa1acb7a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:09.594695 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c7294363-5828-4163-a06e-dd4fa1acb7a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:09.603963 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c7294363-5828-4163-a06e-dd4fa1acb7a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:09.605517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-c7294363-5828-4163-a06e-dd4fa1acb7a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:09.606749 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c7294363-5828-4163-a06e-dd4fa1acb7a8 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.169218 Jul 19 20:58:09.607323 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 395/823] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:09 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:10.624899 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-27d169d3-fc5c-492c-834d-eff9c6b6ea34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:10.625550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-27d169d3-fc5c-492c-834d-eff9c6b6ea34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:10.632126 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-27d169d3-fc5c-492c-834d-eff9c6b6ea34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:10.632576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-27d169d3-fc5c-492c-834d-eff9c6b6ea34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:10.633341 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-27d169d3-fc5c-492c-834d-eff9c6b6ea34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:10.633801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-27d169d3-fc5c-492c-834d-eff9c6b6ea34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:10.761750 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-27d169d3-fc5c-492c-834d-eff9c6b6ea34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:10.770139 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-27d169d3-fc5c-492c-834d-eff9c6b6ea34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:10.771655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-27d169d3-fc5c-492c-834d-eff9c6b6ea34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:10.772813 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-27d169d3-fc5c-492c-834d-eff9c6b6ea34 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.151853 Jul 19 20:58:10.773481 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 429/824] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:10 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:11.791697 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e903426d-fdce-4e3c-9d06-beff5b14da42 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:11.792301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e903426d-fdce-4e3c-9d06-beff5b14da42 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:11.798947 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e903426d-fdce-4e3c-9d06-beff5b14da42 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:11.799392 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e903426d-fdce-4e3c-9d06-beff5b14da42 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:11.800151 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e903426d-fdce-4e3c-9d06-beff5b14da42 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:11.800583 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e903426d-fdce-4e3c-9d06-beff5b14da42 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:11.815529 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:11.943200 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e903426d-fdce-4e3c-9d06-beff5b14da42 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:11.951682 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e903426d-fdce-4e3c-9d06-beff5b14da42 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:11.953181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e903426d-fdce-4e3c-9d06-beff5b14da42 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:11.955181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e903426d-fdce-4e3c-9d06-beff5b14da42 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.167594 Jul 19 20:58:11.955755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 396/825] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:11 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:12.974958 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c5c35e74-c3a1-4575-9a0a-f819036619e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:12.975810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c5c35e74-c3a1-4575-9a0a-f819036619e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:12.982489 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c5c35e74-c3a1-4575-9a0a-f819036619e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:12.982973 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c5c35e74-c3a1-4575-9a0a-f819036619e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:12.983805 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c5c35e74-c3a1-4575-9a0a-f819036619e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:12.984242 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c5c35e74-c3a1-4575-9a0a-f819036619e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:13.114446 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c5c35e74-c3a1-4575-9a0a-f819036619e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:13.122800 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c5c35e74-c3a1-4575-9a0a-f819036619e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:13.124289 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c5c35e74-c3a1-4575-9a0a-f819036619e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:13.125534 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c5c35e74-c3a1-4575-9a0a-f819036619e2 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.154490 Jul 19 20:58:13.126089 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 430/826] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:12 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:13.612347 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-eba5112b-cd58-4a74-9bb0-7b401fb8ccb7 req-4ccd3bee-c933-42ec-8773-14efeebfa524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdf860c-45c6-4d7b-a438-c013db13a81d", "name": "network-vif-plugged", "status": "completed", "tag": "04ab7a63-4e2e-47fd-9f11-50e01794d069"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:13.622441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-eba5112b-cd58-4a74-9bb0-7b401fb8ccb7 req-4ccd3bee-c933-42ec-8773-14efeebfa524 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:13.622954 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-eba5112b-cd58-4a74-9bb0-7b401fb8ccb7 req-4ccd3bee-c933-42ec-8773-14efeebfa524 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:13.634832 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-eba5112b-cd58-4a74-9bb0-7b401fb8ccb7 req-4ccd3bee-c933-42ec-8773-14efeebfa524 service nova] Creating event network-vif-plugged:04ab7a63-4e2e-47fd-9f11-50e01794d069 for instance 0fdf860c-45c6-4d7b-a438-c013db13a81d on hv-cinder-79987 Jul 19 20:58:13.639911 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-eba5112b-cd58-4a74-9bb0-7b401fb8ccb7 req-4ccd3bee-c933-42ec-8773-14efeebfa524 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031780 Jul 19 20:58:13.640541 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 397/827] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:14.143798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-49ee7aff-d082-4583-b7d2-23552e2a8e33 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:14.144459 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-49ee7aff-d082-4583-b7d2-23552e2a8e33 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:14.151519 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-49ee7aff-d082-4583-b7d2-23552e2a8e33 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:14.151964 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-49ee7aff-d082-4583-b7d2-23552e2a8e33 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:14.152718 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-49ee7aff-d082-4583-b7d2-23552e2a8e33 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:14.153149 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-49ee7aff-d082-4583-b7d2-23552e2a8e33 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:14.286719 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-49ee7aff-d082-4583-b7d2-23552e2a8e33 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:14.295621 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-49ee7aff-d082-4583-b7d2-23552e2a8e33 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:14.297215 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-49ee7aff-d082-4583-b7d2-23552e2a8e33 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:14.298908 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-49ee7aff-d082-4583-b7d2-23552e2a8e33 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.159083 Jul 19 20:58:14.299469 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 431/828] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:14 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:15.319140 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-160fb215-41a6-4b52-81a8-ad1f260730a4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:15.319830 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-160fb215-41a6-4b52-81a8-ad1f260730a4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:15.321849 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=30 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:15.327219 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-160fb215-41a6-4b52-81a8-ad1f260730a4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:15.327667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-160fb215-41a6-4b52-81a8-ad1f260730a4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:15.328954 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-160fb215-41a6-4b52-81a8-ad1f260730a4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:15.329586 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-160fb215-41a6-4b52-81a8-ad1f260730a4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:15.460824 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-160fb215-41a6-4b52-81a8-ad1f260730a4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:15.469837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-160fb215-41a6-4b52-81a8-ad1f260730a4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:15.471371 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-160fb215-41a6-4b52-81a8-ad1f260730a4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:15.472558 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-160fb215-41a6-4b52-81a8-ad1f260730a4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.158201 Jul 19 20:58:15.473123 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 398/829] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:15 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:16.491007 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c97f9c84-fa1f-4205-b494-65904ef84ce1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:16.491628 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c97f9c84-fa1f-4205-b494-65904ef84ce1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:16.494074 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=34 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:16.499644 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c97f9c84-fa1f-4205-b494-65904ef84ce1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:16.499854 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c97f9c84-fa1f-4205-b494-65904ef84ce1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:16.501064 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c97f9c84-fa1f-4205-b494-65904ef84ce1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:16.501541 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c97f9c84-fa1f-4205-b494-65904ef84ce1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:16.643109 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c97f9c84-fa1f-4205-b494-65904ef84ce1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:16.651223 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c97f9c84-fa1f-4205-b494-65904ef84ce1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:16.652731 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c97f9c84-fa1f-4205-b494-65904ef84ce1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:16.653929 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c97f9c84-fa1f-4205-b494-65904ef84ce1 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1732 microversion: 2.20 time: 0.166877 Jul 19 20:58:16.654489 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 432/830] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:16 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:17.672643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0ee6a881-afd1-4583-8916-5a567b9eaf4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:17.673188 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0ee6a881-afd1-4583-8916-5a567b9eaf4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:17.679794 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ee6a881-afd1-4583-8916-5a567b9eaf4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:17.680252 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ee6a881-afd1-4583-8916-5a567b9eaf4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:17.681020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ee6a881-afd1-4583-8916-5a567b9eaf4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:17.681491 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ee6a881-afd1-4583-8916-5a567b9eaf4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:17.818734 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0ee6a881-afd1-4583-8916-5a567b9eaf4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:17.828602 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0ee6a881-afd1-4583-8916-5a567b9eaf4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:17.830156 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0ee6a881-afd1-4583-8916-5a567b9eaf4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:17.831343 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0ee6a881-afd1-4583-8916-5a567b9eaf4a tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1719 microversion: 2.20 time: 0.163272 Jul 19 20:58:17.831899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 399/831] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:17 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:58:31.500505 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b4b67072-f276-460b-a0b5-a82a999262c7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:31.501115 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b4b67072-f276-460b-a0b5-a82a999262c7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:31.503167 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:31.503812 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:31.509499 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b4b67072-f276-460b-a0b5-a82a999262c7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:31.509943 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b4b67072-f276-460b-a0b5-a82a999262c7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:31.510702 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b4b67072-f276-460b-a0b5-a82a999262c7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:31.511131 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b4b67072-f276-460b-a0b5-a82a999262c7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:31.535281 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b4b67072-f276-460b-a0b5-a82a999262c7 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/ips" status: 200 len: 146 microversion: 2.1 time: 0.039280 Jul 19 20:58:31.535846 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 433/832] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jul 19 20:58:31 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:32.853241 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-468e343f-fbb0-4a2b-bc18-59675bb9b355 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93831655-291e-4e62-8c48-9ddcc0433a40"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:32.854341 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-468e343f-fbb0-4a2b-bc18-59675bb9b355 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:32.856538 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:32.857240 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=17 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:32.863598 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-468e343f-fbb0-4a2b-bc18-59675bb9b355 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.864056 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-468e343f-fbb0-4a2b-bc18-59675bb9b355 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.864836 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-468e343f-fbb0-4a2b-bc18-59675bb9b355 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.865280 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-468e343f-fbb0-4a2b-bc18-59675bb9b355 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.120836 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-468e343f-fbb0-4a2b-bc18-59675bb9b355 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "POST /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271458 Jul 19 20:58:33.121411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 400/833] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 20:58:32 2022] POST /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:33.394420 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-252539e9-45f5-4e6f-a130-4e1e868fb421 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:33.396263 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-252539e9-45f5-4e6f-a130-4e1e868fb421 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:33.403267 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-252539e9-45f5-4e6f-a130-4e1e868fb421 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.403747 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-252539e9-45f5-4e6f-a130-4e1e868fb421 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.404527 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-252539e9-45f5-4e6f-a130-4e1e868fb421 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.404967 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-252539e9-45f5-4e6f-a130-4e1e868fb421 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.496316 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-252539e9-45f5-4e6f-a130-4e1e868fb421 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "POST /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/action" status: 202 len: 0 microversion: 2.1 time: 0.105654 Jul 19 20:58:33.497423 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 434/834] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 20:58:33 2022] POST /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:58:33.511596 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-45f5fe37-8d6f-4d6b-8b47-75e407fc3c27 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:33.512300 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-45f5fe37-8d6f-4d6b-8b47-75e407fc3c27 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:33.520337 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-45f5fe37-8d6f-4d6b-8b47-75e407fc3c27 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.520838 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-45f5fe37-8d6f-4d6b-8b47-75e407fc3c27 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.521744 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-45f5fe37-8d6f-4d6b-8b47-75e407fc3c27 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.522332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-45f5fe37-8d6f-4d6b-8b47-75e407fc3c27 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.744021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-45f5fe37-8d6f-4d6b-8b47-75e407fc3c27 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:33.753533 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-45f5fe37-8d6f-4d6b-8b47-75e407fc3c27 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1750 microversion: 2.1 time: 0.248641 Jul 19 20:58:33.754140 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 401/835] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:33 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1750 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:34.777293 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-cff8f234-379b-490d-8922-7fa58aeb1349 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:34.778604 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-cff8f234-379b-490d-8922-7fa58aeb1349 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:34.786688 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cff8f234-379b-490d-8922-7fa58aeb1349 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.787133 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cff8f234-379b-490d-8922-7fa58aeb1349 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.788215 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cff8f234-379b-490d-8922-7fa58aeb1349 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.788365 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cff8f234-379b-490d-8922-7fa58aeb1349 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.949891 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-cff8f234-379b-490d-8922-7fa58aeb1349 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:34.959306 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-cff8f234-379b-490d-8922-7fa58aeb1349 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.189903 Jul 19 20:58:34.959995 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 435/836] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:34 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:35.981457 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4c54b916-5417-4224-a958-4ecf6e1f1530 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:35.982625 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4c54b916-5417-4224-a958-4ecf6e1f1530 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:35.992169 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4c54b916-5417-4224-a958-4ecf6e1f1530 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:35.992706 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4c54b916-5417-4224-a958-4ecf6e1f1530 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:35.994031 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4c54b916-5417-4224-a958-4ecf6e1f1530 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:35.994588 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4c54b916-5417-4224-a958-4ecf6e1f1530 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:36.186047 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4c54b916-5417-4224-a958-4ecf6e1f1530 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:36.194948 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4c54b916-5417-4224-a958-4ecf6e1f1530 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.219670 Jul 19 20:58:36.195655 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 402/837] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:35 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:37.215750 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3d285019-1005-4f92-9016-87b48a4a9608 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:37.216414 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3d285019-1005-4f92-9016-87b48a4a9608 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:37.224099 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3d285019-1005-4f92-9016-87b48a4a9608 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:37.224795 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3d285019-1005-4f92-9016-87b48a4a9608 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:37.225910 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3d285019-1005-4f92-9016-87b48a4a9608 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:37.226211 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3d285019-1005-4f92-9016-87b48a4a9608 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:37.384150 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3d285019-1005-4f92-9016-87b48a4a9608 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:37.391209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3d285019-1005-4f92-9016-87b48a4a9608 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.179693 Jul 19 20:58:37.391784 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 436/838] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:37 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:38.408571 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4f1a0211-107b-47ff-b730-84122987f512 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:38.409215 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4f1a0211-107b-47ff-b730-84122987f512 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:38.416292 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4f1a0211-107b-47ff-b730-84122987f512 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:38.416743 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4f1a0211-107b-47ff-b730-84122987f512 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:38.417573 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4f1a0211-107b-47ff-b730-84122987f512 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:38.418020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4f1a0211-107b-47ff-b730-84122987f512 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:38.569852 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4f1a0211-107b-47ff-b730-84122987f512 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:38.578441 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4f1a0211-107b-47ff-b730-84122987f512 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.173359 Jul 19 20:58:38.579017 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 403/839] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:38 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:39.596362 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6c603098-1b82-4305-abb2-8c9928b44ae9 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:39.597080 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6c603098-1b82-4305-abb2-8c9928b44ae9 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:39.604191 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6c603098-1b82-4305-abb2-8c9928b44ae9 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:39.604632 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6c603098-1b82-4305-abb2-8c9928b44ae9 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:39.605427 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6c603098-1b82-4305-abb2-8c9928b44ae9 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:39.605857 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6c603098-1b82-4305-abb2-8c9928b44ae9 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:39.761475 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6c603098-1b82-4305-abb2-8c9928b44ae9 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:39.781391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6c603098-1b82-4305-abb2-8c9928b44ae9 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.185074 Jul 19 20:58:39.782068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 437/840] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:39 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:40.686345 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7b7d0a3e-2952-46ce-bb35-95cd3435b2eb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:40.687332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7b7d0a3e-2952-46ce-bb35-95cd3435b2eb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:40.694033 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7b7d0a3e-2952-46ce-bb35-95cd3435b2eb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:40.694616 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7b7d0a3e-2952-46ce-bb35-95cd3435b2eb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:40.695430 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7b7d0a3e-2952-46ce-bb35-95cd3435b2eb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:40.695874 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7b7d0a3e-2952-46ce-bb35-95cd3435b2eb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:40.729288 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7b7d0a3e-2952-46ce-bb35-95cd3435b2eb tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046851 Jul 19 20:58:40.729885 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 404/841] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:58:40 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:40.739854 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a1f54cf0-aac6-4588-8a5c-d9901600fb28 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:40.740455 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a1f54cf0-aac6-4588-8a5c-d9901600fb28 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:40.747092 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a1f54cf0-aac6-4588-8a5c-d9901600fb28 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:40.747547 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a1f54cf0-aac6-4588-8a5c-d9901600fb28 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:40.748326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a1f54cf0-aac6-4588-8a5c-d9901600fb28 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:40.748767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a1f54cf0-aac6-4588-8a5c-d9901600fb28 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:40.778976 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a1f54cf0-aac6-4588-8a5c-d9901600fb28 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments/93831655-291e-4e62-8c48-9ddcc0433a40" status: 200 len: 194 microversion: 2.1 time: 0.043009 Jul 19 20:58:40.779568 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 438/842] 10.222.0.70 () {58 vars in 1412 bytes} [Tue Jul 19 20:58:40 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments/93831655-291e-4e62-8c48-9ddcc0433a40 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:40.803581 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-30e86e22-cfdd-4974-93a3-2037b3932919 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:40.804419 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-30e86e22-cfdd-4974-93a3-2037b3932919 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:40.812358 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-30e86e22-cfdd-4974-93a3-2037b3932919 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:40.812875 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-30e86e22-cfdd-4974-93a3-2037b3932919 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:40.813813 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-30e86e22-cfdd-4974-93a3-2037b3932919 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:40.814354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-30e86e22-cfdd-4974-93a3-2037b3932919 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:40.975223 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-30e86e22-cfdd-4974-93a3-2037b3932919 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:40.983895 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-30e86e22-cfdd-4974-93a3-2037b3932919 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.185824 Jul 19 20:58:40.993571 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 405/843] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:40 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:42.001899 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-fb887e56-2fe0-43b8-af00-86faf8babc8b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:42.002750 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-fb887e56-2fe0-43b8-af00-86faf8babc8b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:42.009736 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb887e56-2fe0-43b8-af00-86faf8babc8b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:42.010232 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb887e56-2fe0-43b8-af00-86faf8babc8b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:42.011005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb887e56-2fe0-43b8-af00-86faf8babc8b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:42.011441 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fb887e56-2fe0-43b8-af00-86faf8babc8b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:42.140063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-414068ed-e2a5-4ec8-af67-6071f8054055 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffbd1eec-6c30-4504-867a-a427b1abbf5b"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:42.141161 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-414068ed-e2a5-4ec8-af67-6071f8054055 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:42.147945 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-414068ed-e2a5-4ec8-af67-6071f8054055 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:42.148405 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-414068ed-e2a5-4ec8-af67-6071f8054055 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:42.149185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-414068ed-e2a5-4ec8-af67-6071f8054055 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:42.149642 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-414068ed-e2a5-4ec8-af67-6071f8054055 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:42.168363 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-fb887e56-2fe0-43b8-af00-86faf8babc8b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:42.177663 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-fb887e56-2fe0-43b8-af00-86faf8babc8b tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.180223 Jul 19 20:58:42.178412 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 439/844] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:41 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:42.417501 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-414068ed-e2a5-4ec8-af67-6071f8054055 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "POST /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281237 Jul 19 20:58:42.418337 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 406/845] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 20:58:42 2022] POST /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:58:43.198572 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0d724ae6-fd16-4568-882a-98171e489ce1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:43.199140 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0d724ae6-fd16-4568-882a-98171e489ce1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:43.206479 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0d724ae6-fd16-4568-882a-98171e489ce1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:43.206942 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0d724ae6-fd16-4568-882a-98171e489ce1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:43.207719 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0d724ae6-fd16-4568-882a-98171e489ce1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:43.208156 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0d724ae6-fd16-4568-882a-98171e489ce1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:43.363265 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0d724ae6-fd16-4568-882a-98171e489ce1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:43.372500 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0d724ae6-fd16-4568-882a-98171e489ce1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.179969 Jul 19 20:58:43.373090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 440/846] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:43 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:44.394409 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0cea85fe-3897-4d54-a09a-141bb45ae6f4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:44.395830 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0cea85fe-3897-4d54-a09a-141bb45ae6f4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:44.404195 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0cea85fe-3897-4d54-a09a-141bb45ae6f4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:44.404973 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0cea85fe-3897-4d54-a09a-141bb45ae6f4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:44.406366 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0cea85fe-3897-4d54-a09a-141bb45ae6f4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:44.406793 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0cea85fe-3897-4d54-a09a-141bb45ae6f4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:44.562605 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0cea85fe-3897-4d54-a09a-141bb45ae6f4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:44.572012 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0cea85fe-3897-4d54-a09a-141bb45ae6f4 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.183227 Jul 19 20:58:44.573402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 407/847] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:44 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:45.598810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-835b6010-1946-486f-81e2-9bdfd458061c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:45.599778 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-835b6010-1946-486f-81e2-9bdfd458061c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:45.606793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-835b6010-1946-486f-81e2-9bdfd458061c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:45.607247 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-835b6010-1946-486f-81e2-9bdfd458061c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:45.608027 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-835b6010-1946-486f-81e2-9bdfd458061c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:45.609109 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-835b6010-1946-486f-81e2-9bdfd458061c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:45.760876 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-835b6010-1946-486f-81e2-9bdfd458061c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:45.770159 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-835b6010-1946-486f-81e2-9bdfd458061c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.175260 Jul 19 20:58:45.770745 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 441/848] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:45 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:46.789696 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e2366a18-90e6-4a4b-b70d-826f10961366 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:46.790487 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e2366a18-90e6-4a4b-b70d-826f10961366 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:46.797235 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e2366a18-90e6-4a4b-b70d-826f10961366 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:46.797715 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e2366a18-90e6-4a4b-b70d-826f10961366 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:46.798498 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e2366a18-90e6-4a4b-b70d-826f10961366 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:46.798930 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e2366a18-90e6-4a4b-b70d-826f10961366 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:46.963291 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e2366a18-90e6-4a4b-b70d-826f10961366 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:46.976314 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e2366a18-90e6-4a4b-b70d-826f10961366 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.190342 Jul 19 20:58:46.976921 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 408/849] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:46 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:47.996161 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-05191396-1648-4cd7-855d-6d8c633a16ca tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:47.996753 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-05191396-1648-4cd7-855d-6d8c633a16ca tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:48.003654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-05191396-1648-4cd7-855d-6d8c633a16ca tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:48.004113 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-05191396-1648-4cd7-855d-6d8c633a16ca tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:48.004910 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-05191396-1648-4cd7-855d-6d8c633a16ca tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:48.005392 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-05191396-1648-4cd7-855d-6d8c633a16ca tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:48.164252 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-05191396-1648-4cd7-855d-6d8c633a16ca tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:48.176103 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-05191396-1648-4cd7-855d-6d8c633a16ca tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.183775 Jul 19 20:58:48.176698 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 442/850] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:47 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:49.195789 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8f640aa4-e3f9-4a13-a3e5-626f665ae666 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:49.196799 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8f640aa4-e3f9-4a13-a3e5-626f665ae666 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:49.204930 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8f640aa4-e3f9-4a13-a3e5-626f665ae666 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:49.205409 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8f640aa4-e3f9-4a13-a3e5-626f665ae666 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:49.206336 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8f640aa4-e3f9-4a13-a3e5-626f665ae666 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:49.206712 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8f640aa4-e3f9-4a13-a3e5-626f665ae666 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:49.414863 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8f640aa4-e3f9-4a13-a3e5-626f665ae666 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:49.429532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8f640aa4-e3f9-4a13-a3e5-626f665ae666 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1755 microversion: 2.1 time: 0.238465 Jul 19 20:58:49.430398 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 409/851] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:49 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1755 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:49.959498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-62ef02b7-5589-45dd-b982-06c79c65f064 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:49.960452 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-62ef02b7-5589-45dd-b982-06c79c65f064 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:49.968090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-62ef02b7-5589-45dd-b982-06c79c65f064 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:49.968541 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-62ef02b7-5589-45dd-b982-06c79c65f064 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:49.969323 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-62ef02b7-5589-45dd-b982-06c79c65f064 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:49.969791 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-62ef02b7-5589-45dd-b982-06c79c65f064 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:50.002964 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-62ef02b7-5589-45dd-b982-06c79c65f064 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047482 Jul 19 20:58:50.003740 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 443/852] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:58:49 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:50.144022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-30a6e35d-8abf-4857-b096-251e624a0fbc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:50.144437 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-30a6e35d-8abf-4857-b096-251e624a0fbc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:50.150841 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-30a6e35d-8abf-4857-b096-251e624a0fbc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:50.151297 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-30a6e35d-8abf-4857-b096-251e624a0fbc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:50.152088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-30a6e35d-8abf-4857-b096-251e624a0fbc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:50.152535 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-30a6e35d-8abf-4857-b096-251e624a0fbc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:50.183235 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-30a6e35d-8abf-4857-b096-251e624a0fbc tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments/93831655-291e-4e62-8c48-9ddcc0433a40" status: 200 len: 194 microversion: 2.1 time: 0.043355 Jul 19 20:58:50.183843 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 410/853] 10.222.0.70 () {58 vars in 1412 bytes} [Tue Jul 19 20:58:50 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments/93831655-291e-4e62-8c48-9ddcc0433a40 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:50.193598 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-044bb758-4d73-4b66-a55b-b26b16899885 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:50.194095 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-044bb758-4d73-4b66-a55b-b26b16899885 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:50.200307 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-044bb758-4d73-4b66-a55b-b26b16899885 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:50.200751 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-044bb758-4d73-4b66-a55b-b26b16899885 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:50.202048 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-044bb758-4d73-4b66-a55b-b26b16899885 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:50.202482 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-044bb758-4d73-4b66-a55b-b26b16899885 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:50.299695 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-044bb758-4d73-4b66-a55b-b26b16899885 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lazy-loading 'services' on Instance uuid 7c5f79f8-fd4f-4f06-9078-b32830789ea6 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:58:50.379669 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-044bb758-4d73-4b66-a55b-b26b16899885 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments/93831655-291e-4e62-8c48-9ddcc0433a40" status: 202 len: 0 microversion: 2.1 time: 0.189743 Jul 19 20:58:50.380498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 444/854] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jul 19 20:58:50 2022] DELETE /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments/93831655-291e-4e62-8c48-9ddcc0433a40 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:58:50.453294 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fcbe6063-1361-4426-b93c-8ef936b037fb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:50.453944 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-fcbe6063-1361-4426-b93c-8ef936b037fb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:50.460907 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fcbe6063-1361-4426-b93c-8ef936b037fb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:50.461414 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fcbe6063-1361-4426-b93c-8ef936b037fb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:50.462189 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fcbe6063-1361-4426-b93c-8ef936b037fb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:50.462850 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fcbe6063-1361-4426-b93c-8ef936b037fb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:50.622232 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-fcbe6063-1361-4426-b93c-8ef936b037fb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:50.634376 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fcbe6063-1361-4426-b93c-8ef936b037fb tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1758 microversion: 2.1 time: 0.185382 Jul 19 20:58:50.634869 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 411/855] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:50 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:52.567899 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f967a5e2-653c-4652-97d2-6cd5b4388292 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:52.568839 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f967a5e2-653c-4652-97d2-6cd5b4388292 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:52.575939 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f967a5e2-653c-4652-97d2-6cd5b4388292 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:52.576455 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f967a5e2-653c-4652-97d2-6cd5b4388292 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:52.577254 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f967a5e2-653c-4652-97d2-6cd5b4388292 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:52.577724 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f967a5e2-653c-4652-97d2-6cd5b4388292 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:52.614774 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f967a5e2-653c-4652-97d2-6cd5b4388292 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments/ffbd1eec-6c30-4504-867a-a427b1abbf5b" status: 200 len: 194 microversion: 2.1 time: 0.052354 Jul 19 20:58:52.616701 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 445/856] 10.222.0.70 () {58 vars in 1412 bytes} [Tue Jul 19 20:58:52 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments/ffbd1eec-6c30-4504-867a-a427b1abbf5b => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:52.630721 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c25b945f-8aeb-4f5a-9be7-c6cdc4c87a75 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:52.631315 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c25b945f-8aeb-4f5a-9be7-c6cdc4c87a75 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:52.638509 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c25b945f-8aeb-4f5a-9be7-c6cdc4c87a75 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:52.638977 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c25b945f-8aeb-4f5a-9be7-c6cdc4c87a75 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:52.639780 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c25b945f-8aeb-4f5a-9be7-c6cdc4c87a75 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:52.640221 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c25b945f-8aeb-4f5a-9be7-c6cdc4c87a75 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:52.736719 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-c25b945f-8aeb-4f5a-9be7-c6cdc4c87a75 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lazy-loading 'services' on Instance uuid 7c5f79f8-fd4f-4f06-9078-b32830789ea6 {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:58:52.824601 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c25b945f-8aeb-4f5a-9be7-c6cdc4c87a75 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments/ffbd1eec-6c30-4504-867a-a427b1abbf5b" status: 202 len: 0 microversion: 2.1 time: 0.199961 Jul 19 20:58:52.825227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 412/857] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jul 19 20:58:52 2022] DELETE /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments/ffbd1eec-6c30-4504-867a-a427b1abbf5b => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:58:54.026004 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d46b76d8-ede5-4481-b6d5-94a7fd776b5d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:54.027543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d46b76d8-ede5-4481-b6d5-94a7fd776b5d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:54.038641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d46b76d8-ede5-4481-b6d5-94a7fd776b5d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:54.039420 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d46b76d8-ede5-4481-b6d5-94a7fd776b5d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:54.040817 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d46b76d8-ede5-4481-b6d5-94a7fd776b5d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:54.041638 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d46b76d8-ede5-4481-b6d5-94a7fd776b5d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:54.079194 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d46b76d8-ede5-4481-b6d5-94a7fd776b5d tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058774 Jul 19 20:58:54.079811 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 446/858] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:58:54 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:58:54.199369 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8f59812b-c1d1-4305-9187-d2a7a88dae71 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:54.200543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8f59812b-c1d1-4305-9187-d2a7a88dae71 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:54.212113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8f59812b-c1d1-4305-9187-d2a7a88dae71 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:54.212891 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8f59812b-c1d1-4305-9187-d2a7a88dae71 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:54.214318 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8f59812b-c1d1-4305-9187-d2a7a88dae71 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:54.215057 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8f59812b-c1d1-4305-9187-d2a7a88dae71 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:54.222701 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:54.276341 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8f59812b-c1d1-4305-9187-d2a7a88dae71 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082239 Jul 19 20:58:54.277461 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 413/859] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:58:54 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:58:54.340645 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-240830b9-34b5-4432-b229-83c374a6f028 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:54.341141 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-240830b9-34b5-4432-b229-83c374a6f028 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:54.348228 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-240830b9-34b5-4432-b229-83c374a6f028 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:54.348668 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-240830b9-34b5-4432-b229-83c374a6f028 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:54.349879 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-240830b9-34b5-4432-b229-83c374a6f028 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:54.350359 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-240830b9-34b5-4432-b229-83c374a6f028 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:54.382694 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-240830b9-34b5-4432-b229-83c374a6f028 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Going to try to terminate instance {{(pid=129866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:58:54.398319 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:54.487751 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-240830b9-34b5-4432-b229-83c374a6f028 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 204 len: 0 microversion: 2.1 time: 0.150532 Jul 19 20:58:54.488415 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 447/860] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:58:54 2022] DELETE /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:58:54.497683 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-08a6ae8f-ed52-4b2f-8eba-146b9675b481 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:54.498378 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-08a6ae8f-ed52-4b2f-8eba-146b9675b481 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:54.504799 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-08a6ae8f-ed52-4b2f-8eba-146b9675b481 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:54.505264 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-08a6ae8f-ed52-4b2f-8eba-146b9675b481 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:54.506541 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-08a6ae8f-ed52-4b2f-8eba-146b9675b481 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:54.506541 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-08a6ae8f-ed52-4b2f-8eba-146b9675b481 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:54.668131 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-08a6ae8f-ed52-4b2f-8eba-146b9675b481 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:54.682187 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-08a6ae8f-ed52-4b2f-8eba-146b9675b481 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1673 microversion: 2.1 time: 0.188073 Jul 19 20:58:54.683247 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 414/861] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:54 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:55.707466 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3ef3cd71-1f47-4c2c-bf2b-93dfe1c73cf4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:55.708631 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3ef3cd71-1f47-4c2c-bf2b-93dfe1c73cf4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:55.721131 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ef3cd71-1f47-4c2c-bf2b-93dfe1c73cf4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:55.721984 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ef3cd71-1f47-4c2c-bf2b-93dfe1c73cf4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:55.723446 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ef3cd71-1f47-4c2c-bf2b-93dfe1c73cf4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:55.724448 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3ef3cd71-1f47-4c2c-bf2b-93dfe1c73cf4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:55.900508 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3ef3cd71-1f47-4c2c-bf2b-93dfe1c73cf4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:55.913529 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3ef3cd71-1f47-4c2c-bf2b-93dfe1c73cf4 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1673 microversion: 2.1 time: 0.214736 Jul 19 20:58:55.915666 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 448/862] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:55 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1673 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:56.940883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7a6e14cf-e8a0-474e-b835-158c7b48fb8b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:56.941947 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7a6e14cf-e8a0-474e-b835-158c7b48fb8b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:56.952296 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a6e14cf-e8a0-474e-b835-158c7b48fb8b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:56.952946 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a6e14cf-e8a0-474e-b835-158c7b48fb8b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:56.953945 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a6e14cf-e8a0-474e-b835-158c7b48fb8b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:56.954522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7a6e14cf-e8a0-474e-b835-158c7b48fb8b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:57.391885 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7a6e14cf-e8a0-474e-b835-158c7b48fb8b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcb993e2d1842389c5862f0fdb7d4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c1526c58f4c2b9b44a4de6c945846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:57.402863 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7a6e14cf-e8a0-474e-b835-158c7b48fb8b tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 200 len: 1673 microversion: 2.1 time: 0.466807 Jul 19 20:58:57.403760 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 415/863] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:56 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 1673 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:57.781386 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-b53213cb-35ad-4475-b7a7-9c81325eb3c0 req-2133d45c-9fda-4302-a7e5-79f6a7f92c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5f79f8-fd4f-4f06-9078-b32830789ea6", "name": "network-vif-deleted", "tag": "6a3b6b2d-c9b2-47ae-ae20-42c88989fd47"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:57.796623 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-b53213cb-35ad-4475-b7a7-9c81325eb3c0 req-2133d45c-9fda-4302-a7e5-79f6a7f92c97 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:57.797596 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-b53213cb-35ad-4475-b7a7-9c81325eb3c0 req-2133d45c-9fda-4302-a7e5-79f6a7f92c97 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:57.817982 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-b53213cb-35ad-4475-b7a7-9c81325eb3c0 req-2133d45c-9fda-4302-a7e5-79f6a7f92c97 service nova] Creating event network-vif-deleted:6a3b6b2d-c9b2-47ae-ae20-42c88989fd47 for instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 on hv-cinder-79987 Jul 19 20:58:57.828535 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-b53213cb-35ad-4475-b7a7-9c81325eb3c0 req-2133d45c-9fda-4302-a7e5-79f6a7f92c97 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052888 Jul 19 20:58:57.829282 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 449/864] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:58:58.422867 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fcb7ca9c-9a93-474a-beae-b9e7abdeabda tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:58.422867 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-fcb7ca9c-9a93-474a-beae-b9e7abdeabda tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:58.429576 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fcb7ca9c-9a93-474a-beae-b9e7abdeabda tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:58.430207 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fcb7ca9c-9a93-474a-beae-b9e7abdeabda tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:58.431101 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fcb7ca9c-9a93-474a-beae-b9e7abdeabda tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:58.432295 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fcb7ca9c-9a93-474a-beae-b9e7abdeabda tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:58.447232 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-fcb7ca9c-9a93-474a-beae-b9e7abdeabda tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] HTTP exception thrown: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fcb7ca9c-9a93-474a-beae-b9e7abdeabda tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Request method failure captured: Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 HTTP/1.1 Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xkdOHPMo0ZDheibj24z53s-RHDYk04kuCXYu79D7z7Zo3AjwC8g3SRpYNv--IJBTdVXwbxIhkbhWrMXSRuf1j_CyhvyThRij5Mub88TEVTwOK6Void5SpaWeScquXIgQRGKHhp7CcTuNp8q3hpKh6ux9mwrkQihBqb-f4c9FMeJUI4 Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: a35c1526c58f4c2b9b44a4de6c945846 Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:58:58.449306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:58:58.452411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a35c1526c58f4c2b9b44a4de6c945846", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:58:58.452411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:58:58.452411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: a35c1526c58f4c2b9b44a4de6c945846 Jul 19 20:58:58.452411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:58:58.452411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeTestJSON-431306425-project Jul 19 20:58:58.452411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:58:58.452411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:58:58.452411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: cbcb993e2d1842389c5862f0fdb7d4d7 Jul 19 20:58:58.452411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeTestJSON-431306425-project Jul 19 20:58:58.452411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:58:58.452411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:58:58.452411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '7c5f79f8-fd4f-4f06-9078-b32830789ea6'} Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:58.453915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:58:58.456454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:58:58.458968 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fcb7ca9c-9a93-474a-beae-b9e7abdeabda tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Returning 404 to user: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:58.458968 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fcb7ca9c-9a93-474a-beae-b9e7abdeabda tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 404 len: 111 microversion: 2.1 time: 0.035707 Jul 19 20:58:58.458968 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 416/865] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:58 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:58:58.464898 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0d65334a-ba2e-41d2-b353-7739c205395f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '.version_select at 0x7f25276a2430>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:58.493513 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0d65334a-ba2e-41d2-b353-7739c205395f tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264261786" status: 202 len: 0 microversion: 2.1 time: 0.034092 Jul 19 20:58:58.494342 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 450/866] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jul 19 20:58:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264261786 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:59:01.734703 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b64e53cf-4b64-47ae-b1ef-781df106ccbf tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:01.735266 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b64e53cf-4b64-47ae-b1ef-781df106ccbf tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:01.743530 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b64e53cf-4b64-47ae-b1ef-781df106ccbf tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:01.744005 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b64e53cf-4b64-47ae-b1ef-781df106ccbf tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:01.744912 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b64e53cf-4b64-47ae-b1ef-781df106ccbf tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:01.745410 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b64e53cf-4b64-47ae-b1ef-781df106ccbf tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:01.759095 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-b64e53cf-4b64-47ae-b1ef-781df106ccbf tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] HTTP exception thrown: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b64e53cf-4b64-47ae-b1ef-781df106ccbf tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Request method failure captured: Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: DELETE /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 HTTP/1.1 Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xkdOHPMo0ZDheibj24z53s-RHDYk04kuCXYu79D7z7Zo3AjwC8g3SRpYNv--IJBTdVXwbxIhkbhWrMXSRuf1j_CyhvyThRij5Mub88TEVTwOK6Void5SpaWeScquXIgQRGKHhp7CcTuNp8q3hpKh6ux9mwrkQihBqb-f4c9FMeJUI4 Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: a35c1526c58f4c2b9b44a4de6c945846 Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:59:01.760755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:59:01.762333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a35c1526c58f4c2b9b44a4de6c945846", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:01.762333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:59:01.762333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: a35c1526c58f4c2b9b44a4de6c945846 Jul 19 20:59:01.762333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:59:01.762333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeTestJSON-431306425-project Jul 19 20:59:01.762333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:59:01.762333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:59:01.762333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: cbcb993e2d1842389c5862f0fdb7d4d7 Jul 19 20:59:01.762333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeTestJSON-431306425-project Jul 19 20:59:01.762333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:59:01.762333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:59:01.762333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '7c5f79f8-fd4f-4f06-9078-b32830789ea6'} Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:01.763197 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:59:01.764858 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:01.766170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b64e53cf-4b64-47ae-b1ef-781df106ccbf tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Returning 404 to user: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:01.766170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b64e53cf-4b64-47ae-b1ef-781df106ccbf tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 404 len: 111 microversion: 2.1 time: 0.031528 Jul 19 20:59:01.766170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 417/867] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:59:01 2022] DELETE /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:01.771911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-cef7a197-b5d6-4ee0-adde-f20f2c907235 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:01.772700 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-cef7a197-b5d6-4ee0-adde-f20f2c907235 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: 7c5f79f8-fd4f-4f06-9078-b32830789ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:01.774641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:01.780747 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cef7a197-b5d6-4ee0-adde-f20f2c907235 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:01.781271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cef7a197-b5d6-4ee0-adde-f20f2c907235 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:01.782071 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cef7a197-b5d6-4ee0-adde-f20f2c907235 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:01.782511 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cef7a197-b5d6-4ee0-adde-f20f2c907235 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:01.797603 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-cef7a197-b5d6-4ee0-adde-f20f2c907235 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] HTTP exception thrown: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-cef7a197-b5d6-4ee0-adde-f20f2c907235 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Request method failure captured: Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 HTTP/1.1 Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xkdOHPMo0ZDheibj24z53s-RHDYk04kuCXYu79D7z7Zo3AjwC8g3SRpYNv--IJBTdVXwbxIhkbhWrMXSRuf1j_CyhvyThRij5Mub88TEVTwOK6Void5SpaWeScquXIgQRGKHhp7CcTuNp8q3hpKh6ux9mwrkQihBqb-f4c9FMeJUI4 Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: a35c1526c58f4c2b9b44a4de6c945846 Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:01.799275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:01.800801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a35c1526c58f4c2b9b44a4de6c945846", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:01.800801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:59:01.800801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: a35c1526c58f4c2b9b44a4de6c945846 Jul 19 20:59:01.800801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:59:01.800801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-AttachVolumeTestJSON-431306425-project Jul 19 20:59:01.800801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:01.800801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:01.800801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: cbcb993e2d1842389c5862f0fdb7d4d7 Jul 19 20:59:01.800801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-AttachVolumeTestJSON-431306425-project Jul 19 20:59:01.800801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:59:01.800801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:59:01.800801 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '7c5f79f8-fd4f-4f06-9078-b32830789ea6'} Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:01.801842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. Jul 19 20:59:01.803356 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:01.804858 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-cef7a197-b5d6-4ee0-adde-f20f2c907235 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Returning 404 to user: Instance 7c5f79f8-fd4f-4f06-9078-b32830789ea6 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:01.804858 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-cef7a197-b5d6-4ee0-adde-f20f2c907235 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6" status: 404 len: 111 microversion: 2.1 time: 0.033118 Jul 19 20:59:01.804858 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 451/868] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:01 2022] GET /compute/v2.1/servers/7c5f79f8-fd4f-4f06-9078-b32830789ea6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:02.937794 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9e5a2728-6c44-4088-897a-868f05b3d6dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:02.938548 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9e5a2728-6c44-4088-897a-868f05b3d6dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:02.940588 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=37 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:02.945968 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9e5a2728-6c44-4088-897a-868f05b3d6dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:02.946499 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9e5a2728-6c44-4088-897a-868f05b3d6dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:02.947260 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9e5a2728-6c44-4088-897a-868f05b3d6dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:02.947697 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9e5a2728-6c44-4088-897a-868f05b3d6dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:02.961541 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-9e5a2728-6c44-4088-897a-868f05b3d6dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] HTTP exception thrown: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9e5a2728-6c44-4088-897a-868f05b3d6dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Request method failure captured: Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: DELETE /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db HTTP/1.1 Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xkdOHPMo0ZDheibj24z53s-RHDYk04kuCXYu79D7z7Zo3AjwC8g3SRpYNv--IJBTdVXwbxIhkbhWrMXSRuf1j_CyhvyThRij5Mub88TEVTwOK6Void5SpaWeScquXIgQRGKHhp7CcTuNp8q3hpKh6ux9mwrkQihBqb-f4c9FMeJUI4 Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: a35c1526c58f4c2b9b44a4de6c945846 Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:59:02.963128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:59:02.965460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a35c1526c58f4c2b9b44a4de6c945846", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:02.965460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:59:02.965460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: a35c1526c58f4c2b9b44a4de6c945846 Jul 19 20:59:02.965460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:59:02.965460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeTestJSON-431306425-project Jul 19 20:59:02.965460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:59:02.965460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:59:02.965460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: cbcb993e2d1842389c5862f0fdb7d4d7 Jul 19 20:59:02.965460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeTestJSON-431306425-project Jul 19 20:59:02.965460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:59:02.965460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:59:02.965460 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': 'c44e702b-f4f1-46e4-8552-a9440c7b13db'} Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:02.966543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:59:02.968714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:02.971402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9e5a2728-6c44-4088-897a-868f05b3d6dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Returning 404 to user: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:02.971402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9e5a2728-6c44-4088-897a-868f05b3d6dd tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 404 len: 111 microversion: 2.1 time: 0.031312 Jul 19 20:59:02.971402 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 418/869] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:59:02 2022] DELETE /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:02.974994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a3549bcf-0e6f-4a72-a555-158d413d2749 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:02.975611 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a3549bcf-0e6f-4a72-a555-158d413d2749 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] [instance: c44e702b-f4f1-46e4-8552-a9440c7b13db] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:02.982764 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a3549bcf-0e6f-4a72-a555-158d413d2749 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:02.983219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a3549bcf-0e6f-4a72-a555-158d413d2749 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:02.983991 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a3549bcf-0e6f-4a72-a555-158d413d2749 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:02.984431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a3549bcf-0e6f-4a72-a555-158d413d2749 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:02.998657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-a3549bcf-0e6f-4a72-a555-158d413d2749 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] HTTP exception thrown: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a3549bcf-0e6f-4a72-a555-158d413d2749 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Request method failure captured: Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db HTTP/1.1 Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xkdOHPMo0ZDheibj24z53s-RHDYk04kuCXYu79D7z7Zo3AjwC8g3SRpYNv--IJBTdVXwbxIhkbhWrMXSRuf1j_CyhvyThRij5Mub88TEVTwOK6Void5SpaWeScquXIgQRGKHhp7CcTuNp8q3hpKh6ux9mwrkQihBqb-f4c9FMeJUI4 Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: a35c1526c58f4c2b9b44a4de6c945846 Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:03.000255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:03.001793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a35c1526c58f4c2b9b44a4de6c945846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a35c1526c58f4c2b9b44a4de6c945846", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:03.001793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:59:03.001793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: a35c1526c58f4c2b9b44a4de6c945846 Jul 19 20:59:03.001793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-AttachVolumeTestJSON-431306425 Jul 19 20:59:03.001793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-AttachVolumeTestJSON-431306425-project Jul 19 20:59:03.001793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:03.001793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:03.001793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: cbcb993e2d1842389c5862f0fdb7d4d7 Jul 19 20:59:03.001793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-AttachVolumeTestJSON-431306425-project Jul 19 20:59:03.001793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:59:03.001793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:59:03.001793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': 'c44e702b-f4f1-46e4-8552-a9440c7b13db'} Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:03.002634 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. Jul 19 20:59:03.004097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:03.005351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a3549bcf-0e6f-4a72-a555-158d413d2749 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] Returning 404 to user: Instance c44e702b-f4f1-46e4-8552-a9440c7b13db could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:03.005351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a3549bcf-0e6f-4a72-a555-158d413d2749 tempest-AttachVolumeTestJSON-431306425 tempest-AttachVolumeTestJSON-431306425-project] 10.222.0.70 "GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db" status: 404 len: 111 microversion: 2.1 time: 0.031998 Jul 19 20:59:03.005351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 452/870] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:02 2022] GET /compute/v2.1/servers/c44e702b-f4f1-46e4-8552-a9440c7b13db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:06.906361 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8770dc0b-eb87-4977-a487-291f796c3c82 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:06.907381 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8770dc0b-eb87-4977-a487-291f796c3c82 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:06.915302 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8770dc0b-eb87-4977-a487-291f796c3c82 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:06.915986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8770dc0b-eb87-4977-a487-291f796c3c82 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:06.917011 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8770dc0b-eb87-4977-a487-291f796c3c82 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:06.917698 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8770dc0b-eb87-4977-a487-291f796c3c82 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:06.951342 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8770dc0b-eb87-4977-a487-291f796c3c82 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0/ips" status: 200 len: 149 microversion: 2.1 time: 0.049023 Jul 19 20:59:06.952693 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 419/871] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jul 19 20:59:06 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:08.395142 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-76630cec-4a16-4ffa-9959-110ac6db0242 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f32fa1e2-23ea-4bfd-9750-ae29c2264ba1"}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:08.397093 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-76630cec-4a16-4ffa-9959-110ac6db0242 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:08.409898 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-76630cec-4a16-4ffa-9959-110ac6db0242 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:08.410748 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-76630cec-4a16-4ffa-9959-110ac6db0242 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:08.412226 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-76630cec-4a16-4ffa-9959-110ac6db0242 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:08.413067 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-76630cec-4a16-4ffa-9959-110ac6db0242 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:08.938299 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-76630cec-4a16-4ffa-9959-110ac6db0242 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "POST /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.557087 Jul 19 20:59:08.939083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 453/872] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 20:59:08 2022] POST /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0/os-volume_attachments => generated 194 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:08.948443 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:59:08.949211 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Tue Jul 19 20:59:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:59:09.942301 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-cf9a7861-8b68-40af-b7a1-0efa0e1d2b5c tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] Calling method '.version_select at 0x7f2527fe1d30>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:09.994622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-cf9a7861-8b68-40af-b7a1-0efa0e1d2b5c tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/436e9c1e-309e-422a-8da3-cfba79adfdb2" status: 200 len: 351 microversion: 2.1 time: 0.055978 Jul 19 20:59:09.995510 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 420/873] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:59:09 2022] GET /compute/v2.1/os-volumes/436e9c1e-309e-422a-8da3-cfba79adfdb2 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:11.367458 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-46f7db9f-8c5a-41b9-8054-f1ff4e6c0daa tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] Calling method '.version_select at 0x7f2527717dc0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:11.416584 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-46f7db9f-8c5a-41b9-8054-f1ff4e6c0daa tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/36f81eca-5c69-4fd4-95c7-03da1e666f12" status: 200 len: 350 microversion: 2.1 time: 0.053796 Jul 19 20:59:11.417166 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 454/874] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:59:11 2022] GET /compute/v2.1/os-volumes/36f81eca-5c69-4fd4-95c7-03da1e666f12 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:12.828103 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4c3ed474-0cd1-4997-bdc7-e6532ae3ab2b tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] Calling method '.version_select at 0x7f253409b8b0>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:12.888751 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4c3ed474-0cd1-4997-bdc7-e6532ae3ab2b tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/16362fed-49c6-4c0c-bf0e-1f4f4bf56ff4" status: 200 len: 351 microversion: 2.1 time: 0.065540 Jul 19 20:59:12.889502 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 421/875] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:59:12 2022] GET /compute/v2.1/os-volumes/16362fed-49c6-4c0c-bf0e-1f4f4bf56ff4 => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:12.904058 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f0bd432c-4061-433f-9362-a81418999635 tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] Calling method '.version_select at 0x7f25276a1ca0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:13.009935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f0bd432c-4061-433f-9362-a81418999635 tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.112743 Jul 19 20:59:13.010605 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 455/876] 10.222.0.70 () {58 vars in 1133 bytes} [Tue Jul 19 20:59:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:13.023761 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0cbe0fbe-3c55-4497-a198-c48e9c698925 tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] Calling method '.version_select at 0x7f253409b940>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:13.117270 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0cbe0fbe-3c55-4497-a198-c48e9c698925 tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.097457 Jul 19 20:59:13.117876 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 422/877] 10.222.0.70 () {58 vars in 1148 bytes} [Tue Jul 19 20:59:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:13.131080 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8bef212e-3678-4b1b-9694-f1954f8d7e54 tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] Calling method '.version_select at 0x7f25276a1e50>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:13.233343 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8bef212e-3678-4b1b-9694-f1954f8d7e54 tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.106500 Jul 19 20:59:13.234220 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 456/878] 10.222.0.70 () {58 vars in 1133 bytes} [Tue Jul 19 20:59:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:13.246053 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-bcb11483-99fc-4830-9242-ed2f18b1f7b3 tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] Calling method '.version_select at 0x7f2527fe1dc0>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:13.335188 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-bcb11483-99fc-4830-9242-ed2f18b1f7b3 tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092955 Jul 19 20:59:13.335784 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 423/879] 10.222.0.70 () {58 vars in 1166 bytes} [Tue Jul 19 20:59:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:13.348035 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9461a4a6-2a5b-4e16-b19b-561efafea96c tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] Calling method '.version_select at 0x7f2527700af0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:13.430526 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9461a4a6-2a5b-4e16-b19b-561efafea96c tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086332 Jul 19 20:59:13.431127 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 457/880] 10.222.0.70 () {58 vars in 1169 bytes} [Tue Jul 19 20:59:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:13.444815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0a99ab29-7f8d-461e-a386-e714b6fa9ec2 tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] Calling method '.version_select at 0x7f253407cd30>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:13.529978 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0a99ab29-7f8d-461e-a386-e714b6fa9ec2 tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089042 Jul 19 20:59:13.530548 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 424/881] 10.222.0.70 () {58 vars in 1154 bytes} [Tue Jul 19 20:59:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:13.542051 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d7f4acab-047f-49ac-98e3-fb3c73c5aa5c tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] Calling method '.version_select at 0x7f25276a2e50>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:13.637729 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d7f4acab-047f-49ac-98e3-fb3c73c5aa5c tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.099388 Jul 19 20:59:13.638374 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 458/882] 10.222.0.70 () {58 vars in 1187 bytes} [Tue Jul 19 20:59:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:13.651571 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-44ab25f8-74c6-4a7f-acd0-feab777045dd tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] Calling method '.version_select at 0x7f253409ba60>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:13.741981 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-44ab25f8-74c6-4a7f-acd0-feab777045dd tempest-VolumesTestJSON-1742539991 tempest-VolumesTestJSON-1742539991-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.094831 Jul 19 20:59:13.742674 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 425/883] 10.222.0.70 () {58 vars in 1154 bytes} [Tue Jul 19 20:59:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:16.633980 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d856013a-9110-436d-b63d-f4fc8b4d5291 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:16.634773 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d856013a-9110-436d-b63d-f4fc8b4d5291 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:16.642670 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d856013a-9110-436d-b63d-f4fc8b4d5291 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:16.643132 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d856013a-9110-436d-b63d-f4fc8b4d5291 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.643916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d856013a-9110-436d-b63d-f4fc8b4d5291 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:16.644353 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d856013a-9110-436d-b63d-f4fc8b4d5291 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.729568 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-d856013a-9110-436d-b63d-f4fc8b4d5291 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lazy-loading 'services' on Instance uuid a28bbd44-4ddc-470c-83d6-389f4d4697e0 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:59:16.810648 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d856013a-9110-436d-b63d-f4fc8b4d5291 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0/os-volume_attachments/f32fa1e2-23ea-4bfd-9750-ae29c2264ba1" status: 202 len: 0 microversion: 2.1 time: 0.180901 Jul 19 20:59:16.811257 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 459/884] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jul 19 20:59:16 2022] DELETE /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0/os-volume_attachments/f32fa1e2-23ea-4bfd-9750-ae29c2264ba1 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:59:16.820915 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2611f0b8-f482-413e-8ca6-7dd322e686e8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:16.822494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2611f0b8-f482-413e-8ca6-7dd322e686e8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:16.829543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2611f0b8-f482-413e-8ca6-7dd322e686e8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:16.830002 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2611f0b8-f482-413e-8ca6-7dd322e686e8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.830782 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2611f0b8-f482-413e-8ca6-7dd322e686e8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:16.831440 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2611f0b8-f482-413e-8ca6-7dd322e686e8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.873497 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2611f0b8-f482-413e-8ca6-7dd322e686e8 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057240 Jul 19 20:59:16.877622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 426/885] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:59:16 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:17.890146 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c14c31b5-ff25-41cb-8c3d-afc585c1597b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:17.891167 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c14c31b5-ff25-41cb-8c3d-afc585c1597b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:17.897981 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c14c31b5-ff25-41cb-8c3d-afc585c1597b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:17.898387 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c14c31b5-ff25-41cb-8c3d-afc585c1597b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:17.899535 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c14c31b5-ff25-41cb-8c3d-afc585c1597b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:17.900062 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c14c31b5-ff25-41cb-8c3d-afc585c1597b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:17.933809 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c14c31b5-ff25-41cb-8c3d-afc585c1597b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048889 Jul 19 20:59:17.939082 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 460/886] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 20:59:17 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:59:18.001999 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5abce2e4-ccad-43bd-8b33-58e4c74d0d8c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:18.002591 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5abce2e4-ccad-43bd-8b33-58e4c74d0d8c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:18.009900 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5abce2e4-ccad-43bd-8b33-58e4c74d0d8c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.010575 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5abce2e4-ccad-43bd-8b33-58e4c74d0d8c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.011506 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5abce2e4-ccad-43bd-8b33-58e4c74d0d8c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.011970 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5abce2e4-ccad-43bd-8b33-58e4c74d0d8c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.041346 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5abce2e4-ccad-43bd-8b33-58e4c74d0d8c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:59:18.130063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5abce2e4-ccad-43bd-8b33-58e4c74d0d8c tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 204 len: 0 microversion: 2.1 time: 0.131455 Jul 19 20:59:18.130755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 427/887] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:59:17 2022] DELETE /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:59:18.139660 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-015286e4-fd39-4019-8d51-33c6a071104e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:18.140324 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-015286e4-fd39-4019-8d51-33c6a071104e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:18.146726 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-015286e4-fd39-4019-8d51-33c6a071104e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.147184 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-015286e4-fd39-4019-8d51-33c6a071104e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.147993 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-015286e4-fd39-4019-8d51-33c6a071104e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.148493 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-015286e4-fd39-4019-8d51-33c6a071104e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.304217 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-015286e4-fd39-4019-8d51-33c6a071104e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:18.313096 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-015286e4-fd39-4019-8d51-33c6a071104e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1681 microversion: 2.1 time: 0.177891 Jul 19 20:59:18.313792 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 461/888] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:18 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:19.331954 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5edcecd0-5a39-4ec4-a05f-ad65d7847a59 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:19.332643 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5edcecd0-5a39-4ec4-a05f-ad65d7847a59 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:19.339741 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5edcecd0-5a39-4ec4-a05f-ad65d7847a59 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:19.340204 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5edcecd0-5a39-4ec4-a05f-ad65d7847a59 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:19.341020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5edcecd0-5a39-4ec4-a05f-ad65d7847a59 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:19.341480 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5edcecd0-5a39-4ec4-a05f-ad65d7847a59 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:19.493738 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5edcecd0-5a39-4ec4-a05f-ad65d7847a59 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:19.502421 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5edcecd0-5a39-4ec4-a05f-ad65d7847a59 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1681 microversion: 2.1 time: 0.174653 Jul 19 20:59:19.503016 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 428/889] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:19 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:20.521187 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c9f298e7-3f37-4424-841c-bb4a81a667db tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:20.522266 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c9f298e7-3f37-4424-841c-bb4a81a667db tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:20.531822 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c9f298e7-3f37-4424-841c-bb4a81a667db tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.532401 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c9f298e7-3f37-4424-841c-bb4a81a667db tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.533337 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c9f298e7-3f37-4424-841c-bb4a81a667db tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.534051 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c9f298e7-3f37-4424-841c-bb4a81a667db tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.688877 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c9f298e7-3f37-4424-841c-bb4a81a667db tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af989ff6dc024ff19023e6f633915ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da6c42976154440bd0459beb12477f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:20.700566 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c9f298e7-3f37-4424-841c-bb4a81a667db tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 200 len: 1681 microversion: 2.1 time: 0.183945 Jul 19 20:59:20.702481 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 462/890] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:20 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:21.025079 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-06c8432d-064b-4bcc-8160-8f0425d74916 req-61c010f5-380f-4dff-ba21-8cb0c2e33784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28bbd44-4ddc-470c-83d6-389f4d4697e0", "name": "network-vif-deleted", "tag": "07d1592c-6f96-4277-b758-c2adb3515fcf"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:21.047641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-06c8432d-064b-4bcc-8160-8f0425d74916 req-61c010f5-380f-4dff-ba21-8cb0c2e33784 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.048534 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-06c8432d-064b-4bcc-8160-8f0425d74916 req-61c010f5-380f-4dff-ba21-8cb0c2e33784 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.075920 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-06c8432d-064b-4bcc-8160-8f0425d74916 req-61c010f5-380f-4dff-ba21-8cb0c2e33784 service nova] Creating event network-vif-deleted:07d1592c-6f96-4277-b758-c2adb3515fcf for instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 on hv-cinder-79987 Jul 19 20:59:21.084602 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-06c8432d-064b-4bcc-8160-8f0425d74916 req-61c010f5-380f-4dff-ba21-8cb0c2e33784 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063382 Jul 19 20:59:21.087994 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 429/891] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:59:21.720372 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7b58f170-a17f-474c-b768-5d8d499d0fc6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:21.721168 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-7b58f170-a17f-474c-b768-5d8d499d0fc6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:21.729680 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b58f170-a17f-474c-b768-5d8d499d0fc6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.730197 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b58f170-a17f-474c-b768-5d8d499d0fc6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.731987 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b58f170-a17f-474c-b768-5d8d499d0fc6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.732600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b58f170-a17f-474c-b768-5d8d499d0fc6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.749230 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-7b58f170-a17f-474c-b768-5d8d499d0fc6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7b58f170-a17f-474c-b768-5d8d499d0fc6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 HTTP/1.1 Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:21.750925 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:21.752790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:21.752790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:21.752790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:21.752790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:21.752790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:21.752790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:21.752790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:21.752790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:59:21.752790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:21.752790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:59:21.752790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:21.752790 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': 'a28bbd44-4ddc-470c-83d6-389f4d4697e0'} Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:21.753919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:21.756915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:21.758232 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7b58f170-a17f-474c-b768-5d8d499d0fc6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 404 to user: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:21.758232 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-7b58f170-a17f-474c-b768-5d8d499d0fc6 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 404 len: 111 microversion: 2.1 time: 0.036059 Jul 19 20:59:21.758232 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 463/892] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:21 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:21.768953 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4b5bafdb-d47e-415a-b949-b4dc94f1dce7 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '.version_select at 0x7f2534266280>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:21.789102 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4b5bafdb-d47e-415a-b949-b4dc94f1dce7 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-828957770" status: 202 len: 0 microversion: 2.1 time: 0.029124 Jul 19 20:59:21.789753 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 430/893] 10.222.0.70 () {58 vars in 1217 bytes} [Tue Jul 19 20:59:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-828957770 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:59:27.453741 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-046e341a-5ab2-401d-a59a-1b696482d183 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:27.455310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-046e341a-5ab2-401d-a59a-1b696482d183 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:27.464968 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-046e341a-5ab2-401d-a59a-1b696482d183 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.465454 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-046e341a-5ab2-401d-a59a-1b696482d183 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.466303 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-046e341a-5ab2-401d-a59a-1b696482d183 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.466746 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-046e341a-5ab2-401d-a59a-1b696482d183 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.469642 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:27.501721 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-046e341a-5ab2-401d-a59a-1b696482d183 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055821 Jul 19 20:59:27.502292 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 464/894] 10.222.0.70 () {60 vars in 1342 bytes} [Tue Jul 19 20:59:27 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:27.573204 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-aa4195aa-ff8a-4303-8769-22b549d78c10 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:27.573954 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-aa4195aa-ff8a-4303-8769-22b549d78c10 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:27.581049 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-aa4195aa-ff8a-4303-8769-22b549d78c10 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.581539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-aa4195aa-ff8a-4303-8769-22b549d78c10 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.582336 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-aa4195aa-ff8a-4303-8769-22b549d78c10 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.582777 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-aa4195aa-ff8a-4303-8769-22b549d78c10 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.585740 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:27.611772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-aa4195aa-ff8a-4303-8769-22b549d78c10 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:59:27.703463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-aa4195aa-ff8a-4303-8769-22b549d78c10 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 204 len: 0 microversion: 2.20 time: 0.134414 Jul 19 20:59:27.704030 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 431/895] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jul 19 20:59:27 2022] DELETE /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:59:27.712881 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5d43cf57-6553-4399-8517-a99bfe2c5883 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:27.713503 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5d43cf57-6553-4399-8517-a99bfe2c5883 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:27.720432 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5d43cf57-6553-4399-8517-a99bfe2c5883 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.720905 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5d43cf57-6553-4399-8517-a99bfe2c5883 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.721737 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5d43cf57-6553-4399-8517-a99bfe2c5883 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.722191 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5d43cf57-6553-4399-8517-a99bfe2c5883 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.897492 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5d43cf57-6553-4399-8517-a99bfe2c5883 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:27.911673 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5d43cf57-6553-4399-8517-a99bfe2c5883 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:27.913950 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5d43cf57-6553-4399-8517-a99bfe2c5883 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:27.915608 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5d43cf57-6553-4399-8517-a99bfe2c5883 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.207126 Jul 19 20:59:27.926857 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 465/896] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:27 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:59:28.062602 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d965587b-7b9a-4687-8180-a8710bc777c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:28.063266 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d965587b-7b9a-4687-8180-a8710bc777c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:28.070082 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d965587b-7b9a-4687-8180-a8710bc777c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.070599 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d965587b-7b9a-4687-8180-a8710bc777c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.071335 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d965587b-7b9a-4687-8180-a8710bc777c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.071981 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d965587b-7b9a-4687-8180-a8710bc777c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.096003 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-d965587b-7b9a-4687-8180-a8710bc777c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d965587b-7b9a-4687-8180-a8710bc777c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: DELETE /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 HTTP/1.1 Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:59:28.099539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:59:28.101172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:28.101172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:28.101172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:28.101172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:28.101172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:28.101172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:59:28.101172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:59:28.101172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:59:28.101172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:28.101172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:59:28.101172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:28.101172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': 'a28bbd44-4ddc-470c-83d6-389f4d4697e0'} Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:28.102117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:28.103883 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:28.105517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d965587b-7b9a-4687-8180-a8710bc777c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 404 to user: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:28.105517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d965587b-7b9a-4687-8180-a8710bc777c0 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 404 len: 111 microversion: 2.1 time: 0.044478 Jul 19 20:59:28.105517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 432/897] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:59:28 2022] DELETE /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:28.114648 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0248aec0-5c08-4e64-b464-c09371599195 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:28.115269 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0248aec0-5c08-4e64-b464-c09371599195 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a28bbd44-4ddc-470c-83d6-389f4d4697e0] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:28.122484 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0248aec0-5c08-4e64-b464-c09371599195 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.123021 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0248aec0-5c08-4e64-b464-c09371599195 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.124086 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0248aec0-5c08-4e64-b464-c09371599195 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.124951 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0248aec0-5c08-4e64-b464-c09371599195 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.139626 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-0248aec0-5c08-4e64-b464-c09371599195 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0248aec0-5c08-4e64-b464-c09371599195 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 HTTP/1.1 Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:28.141300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:28.143209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:28.143209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:28.143209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:28.143209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:28.143209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:28.143209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:28.143209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:28.143209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:59:28.143209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:28.143209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:59:28.143209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:28.143209 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': 'a28bbd44-4ddc-470c-83d6-389f4d4697e0'} Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:28.144068 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. Jul 19 20:59:28.145310 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:28.146595 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0248aec0-5c08-4e64-b464-c09371599195 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 404 to user: Instance a28bbd44-4ddc-470c-83d6-389f4d4697e0 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:28.146595 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0248aec0-5c08-4e64-b464-c09371599195 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0" status: 404 len: 111 microversion: 2.1 time: 0.033600 Jul 19 20:59:28.146595 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 466/898] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:28 2022] GET /compute/v2.1/servers/a28bbd44-4ddc-470c-83d6-389f4d4697e0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:28.934934 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0678de02-0810-47d1-b822-e39f3bdd764d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:28.935528 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0678de02-0810-47d1-b822-e39f3bdd764d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:28.941772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0678de02-0810-47d1-b822-e39f3bdd764d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.942227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0678de02-0810-47d1-b822-e39f3bdd764d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.943001 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0678de02-0810-47d1-b822-e39f3bdd764d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.943445 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0678de02-0810-47d1-b822-e39f3bdd764d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.096954 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0678de02-0810-47d1-b822-e39f3bdd764d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:29.106929 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0678de02-0810-47d1-b822-e39f3bdd764d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:29.109800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0678de02-0810-47d1-b822-e39f3bdd764d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:29.112095 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0678de02-0810-47d1-b822-e39f3bdd764d tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.181274 Jul 19 20:59:29.113180 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 433/899] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:28 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:29.294302 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2aa329fa-0fa4-4b70-8b5a-338517c323b7 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:29.294876 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2aa329fa-0fa4-4b70-8b5a-338517c323b7 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:29.302400 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2aa329fa-0fa4-4b70-8b5a-338517c323b7 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.303176 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2aa329fa-0fa4-4b70-8b5a-338517c323b7 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.303606 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2aa329fa-0fa4-4b70-8b5a-338517c323b7 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.304036 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2aa329fa-0fa4-4b70-8b5a-338517c323b7 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.319088 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-2aa329fa-0fa4-4b70-8b5a-338517c323b7 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2aa329fa-0fa4-4b70-8b5a-338517c323b7 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: DELETE /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 HTTP/1.1 Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:29.320641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:29.322224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:29.322224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:29.322224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:29.322224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:29.322224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:29.322224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:29.322224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:29.322224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:59:29.322224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:29.322224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:59:29.322224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:59:29.322224 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': 'a0154001-450f-477f-a952-a769ea371c70'} Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:29.323153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:59:29.324728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.326506 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2aa329fa-0fa4-4b70-8b5a-338517c323b7 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 404 to user: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:29.326506 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2aa329fa-0fa4-4b70-8b5a-338517c323b7 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 404 len: 111 microversion: 2.1 time: 0.032082 Jul 19 20:59:29.326506 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 467/900] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:59:29 2022] DELETE /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:29.330935 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5ff4ab5e-ef4b-4dd7-8f52-e9b51a6c00d4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:29.331545 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5ff4ab5e-ef4b-4dd7-8f52-e9b51a6c00d4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: a0154001-450f-477f-a952-a769ea371c70] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:29.340649 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5ff4ab5e-ef4b-4dd7-8f52-e9b51a6c00d4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.341103 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5ff4ab5e-ef4b-4dd7-8f52-e9b51a6c00d4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.341941 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5ff4ab5e-ef4b-4dd7-8f52-e9b51a6c00d4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.342386 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5ff4ab5e-ef4b-4dd7-8f52-e9b51a6c00d4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.357566 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-5ff4ab5e-ef4b-4dd7-8f52-e9b51a6c00d4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5ff4ab5e-ef4b-4dd7-8f52-e9b51a6c00d4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 HTTP/1.1 Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:59:29.359065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:59:29.360666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:29.360666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:29.360666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:29.360666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:29.360666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:29.360666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:59:29.360666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:59:29.360666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:59:29.360666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:29.360666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:59:29.360666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:59:29.360666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': 'a0154001-450f-477f-a952-a769ea371c70'} Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:29.361627 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. Jul 19 20:59:29.363042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.364359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5ff4ab5e-ef4b-4dd7-8f52-e9b51a6c00d4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 404 to user: Instance a0154001-450f-477f-a952-a769ea371c70 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:29.364359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5ff4ab5e-ef4b-4dd7-8f52-e9b51a6c00d4 tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70" status: 404 len: 111 microversion: 2.1 time: 0.033523 Jul 19 20:59:29.364359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 434/901] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:29 2022] GET /compute/v2.1/servers/a0154001-450f-477f-a952-a769ea371c70 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:29.370156 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-acc1b234-cbad-4862-a008-fab589a43e6a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:29.370716 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-acc1b234-cbad-4862-a008-fab589a43e6a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:29.377886 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-acc1b234-cbad-4862-a008-fab589a43e6a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.378373 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-acc1b234-cbad-4862-a008-fab589a43e6a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.379193 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-acc1b234-cbad-4862-a008-fab589a43e6a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.379667 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-acc1b234-cbad-4862-a008-fab589a43e6a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.396091 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-acc1b234-cbad-4862-a008-fab589a43e6a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-acc1b234-cbad-4862-a008-fab589a43e6a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: DELETE /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab HTTP/1.1 Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:29.397947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:29.400327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:29.400327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:29.400327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:29.400327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:29.400327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:29.400327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:29.400327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:29.400327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:59:29.400327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:29.400327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:59:29.400327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:59:29.400327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '30f2c53f-06f9-4306-82e4-df8af346dbab'} Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:29.401992 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:59:29.404613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.406098 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-acc1b234-cbad-4862-a008-fab589a43e6a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 404 to user: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:29.406098 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-acc1b234-cbad-4862-a008-fab589a43e6a tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 404 len: 111 microversion: 2.1 time: 0.033640 Jul 19 20:59:29.406098 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 468/902] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:59:29 2022] DELETE /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:29.410875 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-70a34edd-4983-4c78-98ab-70665ac9e3cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:29.410875 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-70a34edd-4983-4c78-98ab-70665ac9e3cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 30f2c53f-06f9-4306-82e4-df8af346dbab] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:29.417531 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-70a34edd-4983-4c78-98ab-70665ac9e3cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.417995 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-70a34edd-4983-4c78-98ab-70665ac9e3cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.419279 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-70a34edd-4983-4c78-98ab-70665ac9e3cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.419722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-70a34edd-4983-4c78-98ab-70665ac9e3cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.440695 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-70a34edd-4983-4c78-98ab-70665ac9e3cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-70a34edd-4983-4c78-98ab-70665ac9e3cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab HTTP/1.1 Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:59:29.442332 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:59:29.444230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:29.444230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:29.444230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:29.444230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:29.444230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:29.444230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:59:29.444230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:59:29.444230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:59:29.444230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:29.444230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:59:29.444230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:59:29.444230 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '30f2c53f-06f9-4306-82e4-df8af346dbab'} Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:29.445650 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. Jul 19 20:59:29.447412 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:29.448954 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-70a34edd-4983-4c78-98ab-70665ac9e3cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 404 to user: Instance 30f2c53f-06f9-4306-82e4-df8af346dbab could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:29.448954 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-70a34edd-4983-4c78-98ab-70665ac9e3cc tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab" status: 404 len: 111 microversion: 2.1 time: 0.037928 Jul 19 20:59:29.448954 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 435/903] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:29 2022] GET /compute/v2.1/servers/30f2c53f-06f9-4306-82e4-df8af346dbab => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:30.137031 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-040f26c4-c963-45cc-8b67-950f32d24bad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:30.138290 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-040f26c4-c963-45cc-8b67-950f32d24bad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:30.144935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-040f26c4-c963-45cc-8b67-950f32d24bad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:30.145561 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-040f26c4-c963-45cc-8b67-950f32d24bad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:30.146332 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-040f26c4-c963-45cc-8b67-950f32d24bad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:30.146775 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-040f26c4-c963-45cc-8b67-950f32d24bad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:30.320198 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-040f26c4-c963-45cc-8b67-950f32d24bad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:30.331284 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-040f26c4-c963-45cc-8b67-950f32d24bad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:30.332167 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-040f26c4-c963-45cc-8b67-950f32d24bad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31790576f8734f75adbbd8e9c0d61721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8298856e2d28408296cc7e4deca84846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:30.333267 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-040f26c4-c963-45cc-8b67-950f32d24bad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 200 len: 1725 microversion: 2.20 time: 0.200858 Jul 19 20:59:30.334105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 469/904] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:30 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:30.586655 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b3653996-36ef-4fcd-92dc-e3b6618e261b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:30.587370 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b3653996-36ef-4fcd-92dc-e3b6618e261b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:30.595286 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b3653996-36ef-4fcd-92dc-e3b6618e261b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:30.595732 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b3653996-36ef-4fcd-92dc-e3b6618e261b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:30.596517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b3653996-36ef-4fcd-92dc-e3b6618e261b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:30.596949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b3653996-36ef-4fcd-92dc-e3b6618e261b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:30.613842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-b3653996-36ef-4fcd-92dc-e3b6618e261b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b3653996-36ef-4fcd-92dc-e3b6618e261b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: DELETE /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 HTTP/1.1 Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:59:30.615483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:59:30.616837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:30.616837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:30.616837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:30.616837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:30.616837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:30.616837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:59:30.616837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:59:30.616837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:59:30.616837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:30.616837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:59:30.616837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:59:30.616837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '8a3a1c24-8f18-49bb-9bbf-711a808f4ea6'} Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:30.618284 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:59:30.619783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:30.622029 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b3653996-36ef-4fcd-92dc-e3b6618e261b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 404 to user: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:30.622029 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b3653996-36ef-4fcd-92dc-e3b6618e261b tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 404 len: 111 microversion: 2.1 time: 0.034311 Jul 19 20:59:30.622029 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 436/905] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 20:59:30 2022] DELETE /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:59:30.627962 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f6b0330b-52f4-4dcb-9ebb-db57e8de280e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:30.628571 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f6b0330b-52f4-4dcb-9ebb-db57e8de280e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] [instance: 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:30.636062 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f6b0330b-52f4-4dcb-9ebb-db57e8de280e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:30.636518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f6b0330b-52f4-4dcb-9ebb-db57e8de280e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:30.637838 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f6b0330b-52f4-4dcb-9ebb-db57e8de280e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:30.638286 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f6b0330b-52f4-4dcb-9ebb-db57e8de280e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:30.654360 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-f6b0330b-52f4-4dcb-9ebb-db57e8de280e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] HTTP exception thrown: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f6b0330b-52f4-4dcb-9ebb-db57e8de280e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Request method failure captured: Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 HTTP/1.1 Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjMgf1mgxqmM-2QVBNZLXX7D0CS1cVX8TP2h25ReMiRVd8fhIum48uIer6KFs9CtySXgC5cPUEsx8g7tE651bYnY4abLmHZMcBSJVEYavnRCXij_4VnleXlQ2rAuo0C6KrQIIYSahLFZ6tXh8J_AL1-OQvxyVsMqaFpTEpr0ALgSbI Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:30.655927 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:30.657911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5da6c42976154440bd0459beb12477f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5da6c42976154440bd0459beb12477f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5da6c42976154440bd0459beb12477f2", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:30.657911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:30.657911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 5da6c42976154440bd0459beb12477f2 Jul 19 20:59:30.657911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1800812854 Jul 19 20:59:30.657911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:30.657911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:30.657911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:30.657911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: af989ff6dc024ff19023e6f633915ec3 Jul 19 20:59:30.657911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-AttachVolumeNegativeTest-1800812854-project Jul 19 20:59:30.657911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:59:30.657911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:59:30.657911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '8a3a1c24-8f18-49bb-9bbf-711a808f4ea6'} Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:30.663655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. Jul 19 20:59:30.665065 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:30.666461 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f6b0330b-52f4-4dcb-9ebb-db57e8de280e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] Returning 404 to user: Instance 8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:30.666461 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f6b0330b-52f4-4dcb-9ebb-db57e8de280e tempest-AttachVolumeNegativeTest-1800812854 tempest-AttachVolumeNegativeTest-1800812854-project] 10.222.0.70 "GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6" status: 404 len: 111 microversion: 2.1 time: 0.033978 Jul 19 20:59:30.666461 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 470/906] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:30 2022] GET /compute/v2.1/servers/8a3a1c24-8f18-49bb-9bbf-711a808f4ea6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:30.726298 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-81502b5b-cc4f-46d1-b9ad-52c5a250ad68 req-9e9ea102-b780-4c81-a8aa-392d166f0b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdf860c-45c6-4d7b-a438-c013db13a81d", "name": "network-vif-deleted", "tag": "04ab7a63-4e2e-47fd-9f11-50e01794d069"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:30.749835 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-81502b5b-cc4f-46d1-b9ad-52c5a250ad68 req-9e9ea102-b780-4c81-a8aa-392d166f0b82 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:30.750417 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-81502b5b-cc4f-46d1-b9ad-52c5a250ad68 req-9e9ea102-b780-4c81-a8aa-392d166f0b82 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:30.767613 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-81502b5b-cc4f-46d1-b9ad-52c5a250ad68 req-9e9ea102-b780-4c81-a8aa-392d166f0b82 service nova] Creating event network-vif-deleted:04ab7a63-4e2e-47fd-9f11-50e01794d069 for instance 0fdf860c-45c6-4d7b-a438-c013db13a81d on hv-cinder-79987 Jul 19 20:59:30.789028 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-81502b5b-cc4f-46d1-b9ad-52c5a250ad68 req-9e9ea102-b780-4c81-a8aa-392d166f0b82 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068622 Jul 19 20:59:30.793281 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 437/907] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:31.354957 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-53776339-3a02-4b51-9575-f8ee1479859b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:31.355572 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-53776339-3a02-4b51-9575-f8ee1479859b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:31.364218 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-53776339-3a02-4b51-9575-f8ee1479859b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:31.364993 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-53776339-3a02-4b51-9575-f8ee1479859b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:31.365851 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-53776339-3a02-4b51-9575-f8ee1479859b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:31.366283 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-53776339-3a02-4b51-9575-f8ee1479859b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:31.389708 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-53776339-3a02-4b51-9575-f8ee1479859b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] HTTP exception thrown: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-53776339-3a02-4b51-9575-f8ee1479859b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Request method failure captured: Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d HTTP/1.1 Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjN7BWqewYsqIeSXb4fvLrtHf8kRLC0deD9-bnL97GxmNKgEemjEsKNG-S7Yi-yNEGsTW7LBTlS8rO_XOE_vZrVGpSpcllwmTjajNtSOSZ95aKNbR7GPSMVAmxZB9Z__TyerHik-5lqHwtRG4tqO6yGzIRZJp4KnQUkjhJHpLXBE8U Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 8298856e2d28408296cc7e4deca84846 Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:31.391582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:31.393186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8298856e2d28408296cc7e4deca84846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8298856e2d28408296cc7e4deca84846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8298856e2d28408296cc7e4deca84846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8298856e2d28408296cc7e4deca84846", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:31.393186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:31.393186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 8298856e2d28408296cc7e4deca84846 Jul 19 20:59:31.393186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:31.393186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-AttachVolumeShelveTestJSON-1158674853-project Jul 19 20:59:31.393186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:31.393186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:31.393186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: 31790576f8734f75adbbd8e9c0d61721 Jul 19 20:59:31.393186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1158674853-project Jul 19 20:59:31.393186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:59:31.393186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:31.393186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '0fdf860c-45c6-4d7b-a438-c013db13a81d'} Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:31.394234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:31.396090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:31.398715 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-53776339-3a02-4b51-9575-f8ee1479859b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Returning 404 to user: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:31.401344 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-53776339-3a02-4b51-9575-f8ee1479859b tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 404 len: 111 microversion: 2.20 time: 0.050232 Jul 19 20:59:31.402323 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 471/908] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:31 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:59:31.413380 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5b3357c1-4c95-4cf9-88e3-722bc7e2ac95 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '.version_select at 0x7f2534152d30>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:31.438841 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5b3357c1-4c95-4cf9-88e3-722bc7e2ac95 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376639542" status: 204 len: 0 microversion: 2.20 time: 0.029994 Jul 19 20:59:31.439825 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 438/909] 10.222.0.70 () {60 vars in 1261 bytes} [Tue Jul 19 20:59:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376639542 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 20:59:33.540949 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-37c2b114-ecf2-4cee-bfe2-07186fc51d83 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:33.541586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-37c2b114-ecf2-4cee-bfe2-07186fc51d83 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:33.543924 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=32 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:33.549971 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-37c2b114-ecf2-4cee-bfe2-07186fc51d83 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:33.550431 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-37c2b114-ecf2-4cee-bfe2-07186fc51d83 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:33.551207 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-37c2b114-ecf2-4cee-bfe2-07186fc51d83 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:33.551646 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-37c2b114-ecf2-4cee-bfe2-07186fc51d83 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:33.570676 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-37c2b114-ecf2-4cee-bfe2-07186fc51d83 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] HTTP exception thrown: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-37c2b114-ecf2-4cee-bfe2-07186fc51d83 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Request method failure captured: Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: DELETE /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d HTTP/1.1 Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjN7BWqewYsqIeSXb4fvLrtHf8kRLC0deD9-bnL97GxmNKgEemjEsKNG-S7Yi-yNEGsTW7LBTlS8rO_XOE_vZrVGpSpcllwmTjajNtSOSZ95aKNbR7GPSMVAmxZB9Z__TyerHik-5lqHwtRG4tqO6yGzIRZJp4KnQUkjhJHpLXBE8U Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 8298856e2d28408296cc7e4deca84846 Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:33.572326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:33.574052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8298856e2d28408296cc7e4deca84846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8298856e2d28408296cc7e4deca84846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8298856e2d28408296cc7e4deca84846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8298856e2d28408296cc7e4deca84846", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:33.574052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:33.574052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 8298856e2d28408296cc7e4deca84846 Jul 19 20:59:33.574052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:33.574052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-AttachVolumeShelveTestJSON-1158674853-project Jul 19 20:59:33.574052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:33.574052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:33.574052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: 31790576f8734f75adbbd8e9c0d61721 Jul 19 20:59:33.574052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1158674853-project Jul 19 20:59:33.574052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:59:33.574052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:33.574052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '0fdf860c-45c6-4d7b-a438-c013db13a81d'} Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:33.575755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:33.577003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:33.580330 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-37c2b114-ecf2-4cee-bfe2-07186fc51d83 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Returning 404 to user: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:33.580330 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-37c2b114-ecf2-4cee-bfe2-07186fc51d83 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 404 len: 111 microversion: 2.20 time: 0.036741 Jul 19 20:59:33.580330 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 472/910] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jul 19 20:59:33 2022] DELETE /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:59:33.583119 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-61f140a2-39a3-476c-9343-d5b294db2038 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:33.583864 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-61f140a2-39a3-476c-9343-d5b294db2038 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 0fdf860c-45c6-4d7b-a438-c013db13a81d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:33.587303 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:33.593430 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-61f140a2-39a3-476c-9343-d5b294db2038 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:33.593969 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-61f140a2-39a3-476c-9343-d5b294db2038 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:33.594755 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-61f140a2-39a3-476c-9343-d5b294db2038 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:33.595202 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-61f140a2-39a3-476c-9343-d5b294db2038 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:33.611217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-61f140a2-39a3-476c-9343-d5b294db2038 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] HTTP exception thrown: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-61f140a2-39a3-476c-9343-d5b294db2038 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Request method failure captured: Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d HTTP/1.1 Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjN7BWqewYsqIeSXb4fvLrtHf8kRLC0deD9-bnL97GxmNKgEemjEsKNG-S7Yi-yNEGsTW7LBTlS8rO_XOE_vZrVGpSpcllwmTjajNtSOSZ95aKNbR7GPSMVAmxZB9Z__TyerHik-5lqHwtRG4tqO6yGzIRZJp4KnQUkjhJHpLXBE8U Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 8298856e2d28408296cc7e4deca84846 Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:59:33.612960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:59:33.614641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8298856e2d28408296cc7e4deca84846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8298856e2d28408296cc7e4deca84846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8298856e2d28408296cc7e4deca84846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8298856e2d28408296cc7e4deca84846", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:33.614641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:33.614641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 8298856e2d28408296cc7e4deca84846 Jul 19 20:59:33.614641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:33.614641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeShelveTestJSON-1158674853-project Jul 19 20:59:33.614641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:59:33.614641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:59:33.614641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: 31790576f8734f75adbbd8e9c0d61721 Jul 19 20:59:33.614641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1158674853-project Jul 19 20:59:33.614641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:59:33.614641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:33.614641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '0fdf860c-45c6-4d7b-a438-c013db13a81d'} Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:33.615532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. Jul 19 20:59:33.619063 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:33.620647 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-61f140a2-39a3-476c-9343-d5b294db2038 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Returning 404 to user: Instance 0fdf860c-45c6-4d7b-a438-c013db13a81d could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:33.620647 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-61f140a2-39a3-476c-9343-d5b294db2038 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d" status: 404 len: 111 microversion: 2.20 time: 0.035386 Jul 19 20:59:33.620647 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 439/911] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:33 2022] GET /compute/v2.1/servers/0fdf860c-45c6-4d7b-a438-c013db13a81d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:59:34.807824 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ba2ab42f-08d2-48d1-853b-e361c61cafd4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:34.808724 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ba2ab42f-08d2-48d1-853b-e361c61cafd4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:34.818880 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ba2ab42f-08d2-48d1-853b-e361c61cafd4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:34.819528 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ba2ab42f-08d2-48d1-853b-e361c61cafd4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:34.820534 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ba2ab42f-08d2-48d1-853b-e361c61cafd4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:34.821125 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ba2ab42f-08d2-48d1-853b-e361c61cafd4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:34.839519 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-ba2ab42f-08d2-48d1-853b-e361c61cafd4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] HTTP exception thrown: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ba2ab42f-08d2-48d1-853b-e361c61cafd4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Request method failure captured: Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: DELETE /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 HTTP/1.1 Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xjN7BWqewYsqIeSXb4fvLrtHf8kRLC0deD9-bnL97GxmNKgEemjEsKNG-S7Yi-yNEGsTW7LBTlS8rO_XOE_vZrVGpSpcllwmTjajNtSOSZ95aKNbR7GPSMVAmxZB9Z__TyerHik-5lqHwtRG4tqO6yGzIRZJp4KnQUkjhJHpLXBE8U Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 8298856e2d28408296cc7e4deca84846 Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:34.842079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:34.843683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8298856e2d28408296cc7e4deca84846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8298856e2d28408296cc7e4deca84846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8298856e2d28408296cc7e4deca84846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8298856e2d28408296cc7e4deca84846", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:34.843683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:34.843683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 8298856e2d28408296cc7e4deca84846 Jul 19 20:59:34.843683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:34.843683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-AttachVolumeShelveTestJSON-1158674853-project Jul 19 20:59:34.843683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:34.843683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:34.843683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: 31790576f8734f75adbbd8e9c0d61721 Jul 19 20:59:34.843683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1158674853-project Jul 19 20:59:34.843683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 20:59:34.843683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:59:34.843683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '9e43f46e-319f-4ec4-8d5a-0e95995dc370'} Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:34.845084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:59:34.846586 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:34.849970 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ba2ab42f-08d2-48d1-853b-e361c61cafd4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Returning 404 to user: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:34.851045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ba2ab42f-08d2-48d1-853b-e361c61cafd4 tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 404 len: 111 microversion: 2.20 time: 0.047639 Jul 19 20:59:34.852071 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 473/912] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jul 19 20:59:34 2022] DELETE /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:59:34.868665 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fb5e136b-9749-4399-bdf5-fe15be66f4ad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:34.869304 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-fb5e136b-9749-4399-bdf5-fe15be66f4ad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] [instance: 9e43f46e-319f-4ec4-8d5a-0e95995dc370] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:34.876296 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fb5e136b-9749-4399-bdf5-fe15be66f4ad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:34.876817 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fb5e136b-9749-4399-bdf5-fe15be66f4ad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:34.877653 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fb5e136b-9749-4399-bdf5-fe15be66f4ad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:34.878139 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-fb5e136b-9749-4399-bdf5-fe15be66f4ad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:34.898369 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-fb5e136b-9749-4399-bdf5-fe15be66f4ad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] HTTP exception thrown: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fb5e136b-9749-4399-bdf5-fe15be66f4ad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Request method failure captured: Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 HTTP/1.1 Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xjN7BWqewYsqIeSXb4fvLrtHf8kRLC0deD9-bnL97GxmNKgEemjEsKNG-S7Yi-yNEGsTW7LBTlS8rO_XOE_vZrVGpSpcllwmTjajNtSOSZ95aKNbR7GPSMVAmxZB9Z__TyerHik-5lqHwtRG4tqO6yGzIRZJp4KnQUkjhJHpLXBE8U Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 8298856e2d28408296cc7e4deca84846 Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:59:34.899949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:59:34.901812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8298856e2d28408296cc7e4deca84846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8298856e2d28408296cc7e4deca84846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8298856e2d28408296cc7e4deca84846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8298856e2d28408296cc7e4deca84846", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:34.901812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:34.901812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 8298856e2d28408296cc7e4deca84846 Jul 19 20:59:34.901812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1158674853 Jul 19 20:59:34.901812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-AttachVolumeShelveTestJSON-1158674853-project Jul 19 20:59:34.901812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:59:34.901812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:59:34.901812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: 31790576f8734f75adbbd8e9c0d61721 Jul 19 20:59:34.901812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1158674853-project Jul 19 20:59:34.901812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 20:59:34.901812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:59:34.901812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '9e43f46e-319f-4ec4-8d5a-0e95995dc370'} Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:34.905986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. Jul 19 20:59:34.908111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:34.909422 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fb5e136b-9749-4399-bdf5-fe15be66f4ad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] Returning 404 to user: Instance 9e43f46e-319f-4ec4-8d5a-0e95995dc370 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:34.909422 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fb5e136b-9749-4399-bdf5-fe15be66f4ad tempest-AttachVolumeShelveTestJSON-1158674853 tempest-AttachVolumeShelveTestJSON-1158674853-project] 10.222.0.70 "GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370" status: 404 len: 111 microversion: 2.20 time: 0.042300 Jul 19 20:59:34.909422 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 440/913] 10.222.0.70 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:34 2022] GET /compute/v2.1/servers/9e43f46e-319f-4ec4-8d5a-0e95995dc370 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:59:40.612151 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c4011e03-8bb7-48d7-afb2-18d3fea5618e tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Action: 'create', calling method: .version_select at 0x7f25340f8a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1151194297", "metadata": {"Type": "work"}}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c4011e03-8bb7-48d7-afb2-18d3fea5618e tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Request method failure captured: Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 122 Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xs8VvsV83panGC_nKdn_7Sf-qyeSJVCnfxRe9q6s9UNWl0f8f-yhuRtxq2n73xXCweRon_2V5PZ5sKr4O6xUStBdeHuJ9T9kXGFAxWCJMUwy6MA83N6TnBv2Bd7B_8pfIF6KIWd9gxZq60ZLNMwqALcfIYvOMJS9nQt5blVwoky7oc Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: fc46a5fc6c9240ad9234a97d66627fb9 Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:40.628654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fc46a5fc6c9240ad9234a97d66627fb9", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: fc46a5fc6c9240ad9234a97d66627fb9 Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-VolumesNegativeTest-1121077354-project Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: f872791891f44303801e441459245005 Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-VolumesNegativeTest-1121077354-project Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1151194297", "metadata": {"Type": "work"}}} Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: Jul 19 20:59:40.630327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1151194297', 'metadata': {'Type': 'work'}}}} Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi '#$%' Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:40.631328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:59:40.632956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:59:40.634240 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 20:59:40.634240 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.634240 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c4011e03-8bb7-48d7-afb2-18d3fea5618e tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:40.634240 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c4011e03-8bb7-48d7-afb2-18d3fea5618e tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133374 Jul 19 20:59:40.634240 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 474/914] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jul 19 20:59:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:59:40.640570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d30d7f05-d1f3-4592-b22e-369ba6e75ff3 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Action: 'create', calling method: .version_select at 0x7f2527ec5b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-677025281", "metadata": {"Type": "work"}}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d30d7f05-d1f3-4592-b22e-369ba6e75ff3 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Request method failure captured: Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 119 Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xs8VvsV83panGC_nKdn_7Sf-qyeSJVCnfxRe9q6s9UNWl0f8f-yhuRtxq2n73xXCweRon_2V5PZ5sKr4O6xUStBdeHuJ9T9kXGFAxWCJMUwy6MA83N6TnBv2Bd7B_8pfIF6KIWd9gxZq60ZLNMwqALcfIYvOMJS9nQt5blVwoky7oc Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: fc46a5fc6c9240ad9234a97d66627fb9 Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:59:40.643949 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fc46a5fc6c9240ad9234a97d66627fb9", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: fc46a5fc6c9240ad9234a97d66627fb9 Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-VolumesNegativeTest-1121077354-project Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: f872791891f44303801e441459245005 Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-VolumesNegativeTest-1121077354-project Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-677025281", "metadata": {"Type": "work"}}} Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: Jul 19 20:59:40.645517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-677025281', 'metadata': {'Type': 'work'}}}} Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi '0' Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:40.646516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:59:40.648256 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:59:40.649676 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 20:59:40.649676 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.649676 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d30d7f05-d1f3-4592-b22e-369ba6e75ff3 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:40.649676 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d30d7f05-d1f3-4592-b22e-369ba6e75ff3 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009099 Jul 19 20:59:40.649676 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 441/915] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jul 19 20:59:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 20:59:40.655687 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-04ec4f8a-6837-4431-9110-440432dd6cc5 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Action: 'create', calling method: .version_select at 0x7f25276ad310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-253529385", "metadata": {"Type": "work"}}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-04ec4f8a-6837-4431-9110-440432dd6cc5 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Request method failure captured: Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 118 Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xs8VvsV83panGC_nKdn_7Sf-qyeSJVCnfxRe9q6s9UNWl0f8f-yhuRtxq2n73xXCweRon_2V5PZ5sKr4O6xUStBdeHuJ9T9kXGFAxWCJMUwy6MA83N6TnBv2Bd7B_8pfIF6KIWd9gxZq60ZLNMwqALcfIYvOMJS9nQt5blVwoky7oc Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: fc46a5fc6c9240ad9234a97d66627fb9 Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:40.658945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fc46a5fc6c9240ad9234a97d66627fb9", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: fc46a5fc6c9240ad9234a97d66627fb9 Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-VolumesNegativeTest-1121077354-project Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: f872791891f44303801e441459245005 Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-VolumesNegativeTest-1121077354-project Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-253529385", "metadata": {"Type": "work"}}} Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: Jul 19 20:59:40.660478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-253529385', 'metadata': {'Type': 'work'}}}} Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise error Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi '' Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:40.661550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 20:59:40.663219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 20:59:40.664527 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 20:59:40.664527 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.664527 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-04ec4f8a-6837-4431-9110-440432dd6cc5 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:40.664527 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-04ec4f8a-6837-4431-9110-440432dd6cc5 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009398 Jul 19 20:59:40.664527 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 475/916] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jul 19 20:59:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 20:59:40.671322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fff2a615-7bcf-4073-b3c3-a2de8f79f7e6 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Calling method '.version_select at 0x7f2534121700>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:40.702657 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-fff2a615-7bcf-4073-b3c3-a2de8f79f7e6 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] HTTP exception thrown: Volume tempest-invalid-901623446 could not be found. Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fff2a615-7bcf-4073-b3c3-a2de8f79f7e6 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Request method failure captured: Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-901623446 HTTP/1.1 Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xs8VvsV83panGC_nKdn_7Sf-qyeSJVCnfxRe9q6s9UNWl0f8f-yhuRtxq2n73xXCweRon_2V5PZ5sKr4O6xUStBdeHuJ9T9kXGFAxWCJMUwy6MA83N6TnBv2Bd7B_8pfIF6KIWd9gxZq60ZLNMwqALcfIYvOMJS9nQt5blVwoky7oc Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: fc46a5fc6c9240ad9234a97d66627fb9 Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:59:40.704656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fc46a5fc6c9240ad9234a97d66627fb9", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: fc46a5fc6c9240ad9234a97d66627fb9 Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-VolumesNegativeTest-1121077354-project Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: f872791891f44303801e441459245005 Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-VolumesNegativeTest-1121077354-project Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Volume tempest-invalid-901623446 could not be found. Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': 'tempest-invalid-901623446'} Jul 19 20:59:40.706217 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-901623446 could not be found. (HTTP 404) (Request-ID: req-f8fa173c-dd48-4c47-9d2f-7ff7faeb928a) Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.707178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:59:40.708570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-901623446 could not be found. Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:40.709933 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-901623446 could not be found. Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-901623446 could not be found. Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-fff2a615-7bcf-4073-b3c3-a2de8f79f7e6 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Returning 404 to user: Volume tempest-invalid-901623446 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-fff2a615-7bcf-4073-b3c3-a2de8f79f7e6 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-901623446" status: 404 len: 98 microversion: 2.1 time: 0.039340 Jul 19 20:59:40.711364 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 442/917] 10.222.0.70 () {58 vars in 1214 bytes} [Tue Jul 19 20:59:40 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-901623446 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:59:40.717104 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8ecad0da-d331-4b2c-ac10-cc9bfb1a214d tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004547 Jul 19 20:59:40.717625 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 476/918] 10.222.0.70 () {58 vars in 1139 bytes} [Tue Jul 19 20:59:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 20:59:40.726658 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2153e498-e67e-42aa-bb30-2f60124b0d48 tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004132 Jul 19 20:59:40.727257 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 443/919] 10.222.0.70 () {58 vars in 1136 bytes} [Tue Jul 19 20:59:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 20:59:40.737832 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e42a0cd8-3a44-4a1f-9e4f-daeeaec8970c tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Calling method '.version_select at 0x7f2527736280>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:40.769621 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-e42a0cd8-3a44-4a1f-9e4f-daeeaec8970c tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] HTTP exception thrown: Volume ed7461d7-2fe3-4cdb-a419-d85dc490f954 could not be found. Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e42a0cd8-3a44-4a1f-9e4f-daeeaec8970c tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Request method failure captured: Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: DELETE /compute/v2.1/os-volumes/ed7461d7-2fe3-4cdb-a419-d85dc490f954 HTTP/1.1 Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xs8VvsV83panGC_nKdn_7Sf-qyeSJVCnfxRe9q6s9UNWl0f8f-yhuRtxq2n73xXCweRon_2V5PZ5sKr4O6xUStBdeHuJ9T9kXGFAxWCJMUwy6MA83N6TnBv2Bd7B_8pfIF6KIWd9gxZq60ZLNMwqALcfIYvOMJS9nQt5blVwoky7oc Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: fc46a5fc6c9240ad9234a97d66627fb9 Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 20:59:40.771576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fc46a5fc6c9240ad9234a97d66627fb9", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: fc46a5fc6c9240ad9234a97d66627fb9 Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-VolumesNegativeTest-1121077354-project Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: f872791891f44303801e441459245005 Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-VolumesNegativeTest-1121077354-project Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Volume ed7461d7-2fe3-4cdb-a419-d85dc490f954 could not be found. Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': 'ed7461d7-2fe3-4cdb-a419-d85dc490f954'} Jul 19 20:59:40.773083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed7461d7-2fe3-4cdb-a419-d85dc490f954 could not be found. (HTTP 404) (Request-ID: req-3ae50491-9f79-4d2b-b94e-d867fdd238b5) Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.774154 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:59:40.775498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed7461d7-2fe3-4cdb-a419-d85dc490f954 could not be found. Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 20:59:40.777061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed7461d7-2fe3-4cdb-a419-d85dc490f954 could not be found. Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed7461d7-2fe3-4cdb-a419-d85dc490f954 could not be found. Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e42a0cd8-3a44-4a1f-9e4f-daeeaec8970c tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Returning 404 to user: Volume ed7461d7-2fe3-4cdb-a419-d85dc490f954 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e42a0cd8-3a44-4a1f-9e4f-daeeaec8970c tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/ed7461d7-2fe3-4cdb-a419-d85dc490f954" status: 404 len: 109 microversion: 2.1 time: 0.039297 Jul 19 20:59:40.779041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 477/920] 10.222.0.70 () {58 vars in 1247 bytes} [Tue Jul 19 20:59:40 2022] DELETE /compute/v2.1/os-volumes/ed7461d7-2fe3-4cdb-a419-d85dc490f954 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:40.784090 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d30f14dd-1c87-448a-b089-be5399a9ec0a tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Calling method '.version_select at 0x7f253409b430>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:40.815737 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-d30f14dd-1c87-448a-b089-be5399a9ec0a tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] HTTP exception thrown: Volume 2b6a15fb-5c1e-4ed1-b756-27090be52fbf could not be found. Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d30f14dd-1c87-448a-b089-be5399a9ec0a tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Request method failure captured: Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/os-volumes/2b6a15fb-5c1e-4ed1-b756-27090be52fbf HTTP/1.1 Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xs8VvsV83panGC_nKdn_7Sf-qyeSJVCnfxRe9q6s9UNWl0f8f-yhuRtxq2n73xXCweRon_2V5PZ5sKr4O6xUStBdeHuJ9T9kXGFAxWCJMUwy6MA83N6TnBv2Bd7B_8pfIF6KIWd9gxZq60ZLNMwqALcfIYvOMJS9nQt5blVwoky7oc Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: fc46a5fc6c9240ad9234a97d66627fb9 Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 20:59:40.818354 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fc46a5fc6c9240ad9234a97d66627fb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fc46a5fc6c9240ad9234a97d66627fb9", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: fc46a5fc6c9240ad9234a97d66627fb9 Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-VolumesNegativeTest-1121077354 Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-VolumesNegativeTest-1121077354-project Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: f872791891f44303801e441459245005 Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-VolumesNegativeTest-1121077354-project Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Volume 2b6a15fb-5c1e-4ed1-b756-27090be52fbf could not be found. Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '2b6a15fb-5c1e-4ed1-b756-27090be52fbf'} Jul 19 20:59:40.821564 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b6a15fb-5c1e-4ed1-b756-27090be52fbf could not be found. (HTTP 404) (Request-ID: req-6a6e3bb8-bf01-4ee3-abc3-90ffe7c8e758) Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.822873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:59:40.825125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b6a15fb-5c1e-4ed1-b756-27090be52fbf could not be found. Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:59:40.826853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b6a15fb-5c1e-4ed1-b756-27090be52fbf could not be found. Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b6a15fb-5c1e-4ed1-b756-27090be52fbf could not be found. Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d30f14dd-1c87-448a-b089-be5399a9ec0a tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] Returning 404 to user: Volume 2b6a15fb-5c1e-4ed1-b756-27090be52fbf could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d30f14dd-1c87-448a-b089-be5399a9ec0a tempest-VolumesNegativeTest-1121077354 tempest-VolumesNegativeTest-1121077354-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/2b6a15fb-5c1e-4ed1-b756-27090be52fbf" status: 404 len: 109 microversion: 2.1 time: 0.040160 Jul 19 20:59:40.828553 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 444/921] 10.222.0.70 () {58 vars in 1244 bytes} [Tue Jul 19 20:59:40 2022] GET /compute/v2.1/os-volumes/2b6a15fb-5c1e-4ed1-b756-27090be52fbf => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 21:00:49.262695 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=3 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:49.264142 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=31 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:49.269287 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ac7110fd-62d6-45df-adcd-230a01cb5894 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-381350778"}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:49.270727 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ac7110fd-62d6-45df-adcd-230a01cb5894 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:49.278093 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ac7110fd-62d6-45df-adcd-230a01cb5894 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:49.278536 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ac7110fd-62d6-45df-adcd-230a01cb5894 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:49.280046 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ac7110fd-62d6-45df-adcd-230a01cb5894 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:49.280578 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ac7110fd-62d6-45df-adcd-230a01cb5894 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:49.420217 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.network.security_group_api [None req-ac7110fd-62d6-45df-adcd-230a01cb5894 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Removing security group fd78f80b-f43c-453c-b8bb-7d3954de87d1 from port 1ccc96a0-961a-4491-b458-91a6ced6d896 Jul 19 21:00:49.780373 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ac7110fd-62d6-45df-adcd-230a01cb5894 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "POST /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/action" status: 202 len: 0 microversion: 2.1 time: 0.519421 Jul 19 21:00:49.781479 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 478/922] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 21:00:49 2022] POST /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:00:49.788357 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:49.789459 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:50.081082 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-99fc72e7-e734-4c21-bc62-2701ca841c61 req-6310b569-1920-4ef4-a703-af979ce6124a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebc1845-f1c0-4b88-b056-045377c6ef1c", "tag": "1ccc96a0-961a-4491-b458-91a6ced6d896"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:50.106934 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-99fc72e7-e734-4c21-bc62-2701ca841c61 req-6310b569-1920-4ef4-a703-af979ce6124a service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:50.107795 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-99fc72e7-e734-4c21-bc62-2701ca841c61 req-6310b569-1920-4ef4-a703-af979ce6124a service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:50.125583 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-99fc72e7-e734-4c21-bc62-2701ca841c61 req-6310b569-1920-4ef4-a703-af979ce6124a service nova] Creating event network-changed:1ccc96a0-961a-4491-b458-91a6ced6d896 for instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c on hv-cinder-79987 Jul 19 21:00:50.134102 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-99fc72e7-e734-4c21-bc62-2701ca841c61 req-6310b569-1920-4ef4-a703-af979ce6124a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347858 Jul 19 21:00:50.135159 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 445/923] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:51.616368 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-aae47bfb-50c7-480e-9ba1-54527af2a54f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:51.617617 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-aae47bfb-50c7-480e-9ba1-54527af2a54f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:51.626581 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aae47bfb-50c7-480e-9ba1-54527af2a54f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:51.627428 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aae47bfb-50c7-480e-9ba1-54527af2a54f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:51.628759 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aae47bfb-50c7-480e-9ba1-54527af2a54f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:51.629407 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-aae47bfb-50c7-480e-9ba1-54527af2a54f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:51.743892 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-aae47bfb-50c7-480e-9ba1-54527af2a54f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lazy-loading 'services' on Instance uuid 7ebc1845-f1c0-4b88-b056-045377c6ef1c {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:00:51.859994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-aae47bfb-50c7-480e-9ba1-54527af2a54f tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/os-volume_attachments/36a33cac-883b-434a-9ec0-c8adbdb467ee" status: 202 len: 0 microversion: 2.1 time: 0.245976 Jul 19 21:00:51.869532 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 479/924] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jul 19 21:00:51 2022] DELETE /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/os-volume_attachments/36a33cac-883b-434a-9ec0-c8adbdb467ee => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:00:51.874810 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d1698661-b645-4a02-ac18-dc27616c48ea tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:51.877519 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d1698661-b645-4a02-ac18-dc27616c48ea tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:51.890306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d1698661-b645-4a02-ac18-dc27616c48ea tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:51.890966 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d1698661-b645-4a02-ac18-dc27616c48ea tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:51.892425 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d1698661-b645-4a02-ac18-dc27616c48ea tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:51.893398 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d1698661-b645-4a02-ac18-dc27616c48ea tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:51.944251 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d1698661-b645-4a02-ac18-dc27616c48ea tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076982 Jul 19 21:00:51.950097 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 446/925] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 21:00:51 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:00:52.275035 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-f51e9b96-04ba-47f4-b711-2b77dc09b4fe req-e1ace19e-401e-4eb5-b458-9592ef1b8eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebc1845-f1c0-4b88-b056-045377c6ef1c", "tag": "1ccc96a0-961a-4491-b458-91a6ced6d896"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:52.287113 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-f51e9b96-04ba-47f4-b711-2b77dc09b4fe req-e1ace19e-401e-4eb5-b458-9592ef1b8eb0 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:52.287567 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-f51e9b96-04ba-47f4-b711-2b77dc09b4fe req-e1ace19e-401e-4eb5-b458-9592ef1b8eb0 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:52.299580 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-f51e9b96-04ba-47f4-b711-2b77dc09b4fe req-e1ace19e-401e-4eb5-b458-9592ef1b8eb0 service nova] Creating event network-changed:1ccc96a0-961a-4491-b458-91a6ced6d896 for instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c on hv-cinder-79987 Jul 19 21:00:52.304525 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-f51e9b96-04ba-47f4-b711-2b77dc09b4fe req-e1ace19e-401e-4eb5-b458-9592ef1b8eb0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033947 Jul 19 21:00:52.305461 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 480/926] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:00:52.966335 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2091729e-d829-4773-820b-96efd9e6bca5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:52.969670 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2091729e-d829-4773-820b-96efd9e6bca5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:52.977440 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2091729e-d829-4773-820b-96efd9e6bca5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:52.978188 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2091729e-d829-4773-820b-96efd9e6bca5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:52.979632 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2091729e-d829-4773-820b-96efd9e6bca5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:52.980325 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2091729e-d829-4773-820b-96efd9e6bca5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:53.045513 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2091729e-d829-4773-820b-96efd9e6bca5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088311 Jul 19 21:00:53.047759 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 447/927] 10.222.0.70 () {58 vars in 1301 bytes} [Tue Jul 19 21:00:52 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 21:00:53.061222 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a29b2441-cad6-476d-9930-abad86c2e553 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:53.062583 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a29b2441-cad6-476d-9930-abad86c2e553 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:53.074401 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a29b2441-cad6-476d-9930-abad86c2e553 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:53.074939 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a29b2441-cad6-476d-9930-abad86c2e553 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:53.077043 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a29b2441-cad6-476d-9930-abad86c2e553 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:53.077627 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a29b2441-cad6-476d-9930-abad86c2e553 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:53.198798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-a29b2441-cad6-476d-9930-abad86c2e553 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] HTTP exception thrown: Instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c is not attached to volume 36a33cac-883b-434a-9ec0-c8adbdb467ee Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a29b2441-cad6-476d-9930-abad86c2e553 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Request method failure captured: Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: DELETE /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/os-volume_attachments/36a33cac-883b-434a-9ec0-c8adbdb467ee HTTP/1.1 Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xpp-yfRd4vxcbAC1LV_HsuI5DQYuwH8uzR5I_ZFqIN1W_KbKVG1up2SCu_gxO9I33d24jB_zsPaKy5Z52cvovqQRAqGY9P4z5KA9vwYaZkOzBUBHvaaR-PlxRwoTMziFQmA0TtR4_8PjuYP7yeOJ7s8uh6-l5ZffZ3NdGkY-wPIFPk Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 3dcf50fca2134c84812de75fed624869 Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-TestMinimumBasicScenario-401178554 Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 21:00:53.202144 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 21:00:53.203994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3dcf50fca2134c84812de75fed624869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3dcf50fca2134c84812de75fed624869"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3dcf50fca2134c84812de75fed624869"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3dcf50fca2134c84812de75fed624869", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 21:00:53.203994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-TestMinimumBasicScenario-401178554 Jul 19 21:00:53.203994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 3dcf50fca2134c84812de75fed624869 Jul 19 21:00:53.203994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-TestMinimumBasicScenario-401178554 Jul 19 21:00:53.203994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-TestMinimumBasicScenario-401178554-project Jul 19 21:00:53.203994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 21:00:53.203994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 21:00:53.203994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: c0bbce46598c465bb29cb0353f10e3eb Jul 19 21:00:53.203994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-TestMinimumBasicScenario-401178554-project Jul 19 21:00:53.203994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 21:00:53.203994 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c is not attached to volume 36a33cac-883b-434a-9ec0-c8adbdb467ee Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'server_id': '7ebc1845-f1c0-4b88-b056-045377c6ef1c', 'id': '36a33cac-883b-434a-9ec0-c8adbdb467ee'} Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 36a33cac-883b-434a-9ec0-c8adbdb467ee. Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:00:53.204782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c is not attached to volume 36a33cac-883b-434a-9ec0-c8adbdb467ee Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c is not attached to volume 36a33cac-883b-434a-9ec0-c8adbdb467ee Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:00:53.206350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a29b2441-cad6-476d-9930-abad86c2e553 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Returning 404 to user: Instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c is not attached to volume 36a33cac-883b-434a-9ec0-c8adbdb467ee {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:00:53.207637 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a29b2441-cad6-476d-9930-abad86c2e553 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/os-volume_attachments/36a33cac-883b-434a-9ec0-c8adbdb467ee" status: 404 len: 154 microversion: 2.1 time: 0.150565 Jul 19 21:00:53.207891 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 481/928] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jul 19 21:00:53 2022] DELETE /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c/os-volume_attachments/36a33cac-883b-434a-9ec0-c8adbdb467ee => generated 154 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:01:00.684336 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-328e7bd6-a7aa-454d-a230-742f5e3b70e3 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:00.684894 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-328e7bd6-a7aa-454d-a230-742f5e3b70e3 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:00.691450 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-328e7bd6-a7aa-454d-a230-742f5e3b70e3 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:00.691940 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-328e7bd6-a7aa-454d-a230-742f5e3b70e3 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:00.692670 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-328e7bd6-a7aa-454d-a230-742f5e3b70e3 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:00.693111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-328e7bd6-a7aa-454d-a230-742f5e3b70e3 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:00.719067 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-328e7bd6-a7aa-454d-a230-742f5e3b70e3 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:01:00.799611 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-328e7bd6-a7aa-454d-a230-742f5e3b70e3 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 204 len: 0 microversion: 2.1 time: 0.118831 Jul 19 21:01:00.800328 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 448/929] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 21:01:00 2022] DELETE /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:01:00.809191 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d72f1860-7e5f-415d-b0da-36f87e7450d5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:00.810565 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d72f1860-7e5f-415d-b0da-36f87e7450d5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:00.819848 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d72f1860-7e5f-415d-b0da-36f87e7450d5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:00.820314 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d72f1860-7e5f-415d-b0da-36f87e7450d5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:00.821116 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d72f1860-7e5f-415d-b0da-36f87e7450d5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:00.821604 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d72f1860-7e5f-415d-b0da-36f87e7450d5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:00.969192 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d72f1860-7e5f-415d-b0da-36f87e7450d5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:00.977351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d72f1860-7e5f-415d-b0da-36f87e7450d5 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1553 microversion: 2.1 time: 0.172789 Jul 19 21:01:00.977953 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 482/930] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:00 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:02.001494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8838bf9e-915c-4931-b1b9-34c623f5564e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:02.002233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8838bf9e-915c-4931-b1b9-34c623f5564e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:02.009191 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8838bf9e-915c-4931-b1b9-34c623f5564e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:02.009678 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8838bf9e-915c-4931-b1b9-34c623f5564e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:02.010489 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8838bf9e-915c-4931-b1b9-34c623f5564e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:02.010935 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8838bf9e-915c-4931-b1b9-34c623f5564e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:02.163279 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8838bf9e-915c-4931-b1b9-34c623f5564e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:02.170813 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8838bf9e-915c-4931-b1b9-34c623f5564e tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1553 microversion: 2.1 time: 0.174161 Jul 19 21:01:02.171370 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 449/931] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:01 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:03.188125 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-464d3b04-3b5e-4be5-b0b6-02a980b641f1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:03.190866 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-464d3b04-3b5e-4be5-b0b6-02a980b641f1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:03.200010 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-464d3b04-3b5e-4be5-b0b6-02a980b641f1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:03.200473 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-464d3b04-3b5e-4be5-b0b6-02a980b641f1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:03.202220 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-464d3b04-3b5e-4be5-b0b6-02a980b641f1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:03.202674 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-464d3b04-3b5e-4be5-b0b6-02a980b641f1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:03.403923 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-464d3b04-3b5e-4be5-b0b6-02a980b641f1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:03.413807 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-464d3b04-3b5e-4be5-b0b6-02a980b641f1 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1553 microversion: 2.1 time: 0.230038 Jul 19 21:01:03.414510 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 483/932] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:03 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:04.119391 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-a8e9dd7f-b73b-4765-9aad-79090f50ff44 req-936d57bc-51fa-43e3-98bb-2761166016ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebc1845-f1c0-4b88-b056-045377c6ef1c", "name": "network-vif-deleted", "tag": "1ccc96a0-961a-4491-b458-91a6ced6d896"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:04.127126 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-a8e9dd7f-b73b-4765-9aad-79090f50ff44 req-936d57bc-51fa-43e3-98bb-2761166016ba service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:04.127815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-a8e9dd7f-b73b-4765-9aad-79090f50ff44 req-936d57bc-51fa-43e3-98bb-2761166016ba service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:04.143624 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-a8e9dd7f-b73b-4765-9aad-79090f50ff44 req-936d57bc-51fa-43e3-98bb-2761166016ba service nova] Creating event network-vif-deleted:1ccc96a0-961a-4491-b458-91a6ced6d896 for instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c on hv-cinder-79987 Jul 19 21:01:04.149861 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-a8e9dd7f-b73b-4765-9aad-79090f50ff44 req-936d57bc-51fa-43e3-98bb-2761166016ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271757 Jul 19 21:01:04.150498 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 450/933] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:04.433743 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7b363e21-3170-4ea5-9a6a-2142cce3a3e0 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:04.434681 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-7b363e21-3170-4ea5-9a6a-2142cce3a3e0 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:04.443034 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b363e21-3170-4ea5-9a6a-2142cce3a3e0 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:04.445027 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b363e21-3170-4ea5-9a6a-2142cce3a3e0 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:04.446341 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b363e21-3170-4ea5-9a6a-2142cce3a3e0 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:04.447323 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b363e21-3170-4ea5-9a6a-2142cce3a3e0 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:04.500728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b363e21-3170-4ea5-9a6a-2142cce3a3e0 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:04.501391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7b363e21-3170-4ea5-9a6a-2142cce3a3e0 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:04.502020 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-7b363e21-3170-4ea5-9a6a-2142cce3a3e0 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lazy-loading 'fault' on Instance uuid 7ebc1845-f1c0-4b88-b056-045377c6ef1c {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:01:04.551895 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-7b363e21-3170-4ea5-9a6a-2142cce3a3e0 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0bbce46598c465bb29cb0353f10e3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcf50fca2134c84812de75fed624869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:04.560281 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-7b363e21-3170-4ea5-9a6a-2142cce3a3e0 tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 200 len: 1346 microversion: 2.1 time: 0.130458 Jul 19 21:01:04.570406 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 484/934] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:04 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 1346 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:05.578685 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-77986e5a-34bc-4b23-9a94-9cd1bea7ca6c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:05.579393 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-77986e5a-34bc-4b23-9a94-9cd1bea7ca6c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] [instance: 7ebc1845-f1c0-4b88-b056-045377c6ef1c] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:05.588191 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-77986e5a-34bc-4b23-9a94-9cd1bea7ca6c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:05.588686 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-77986e5a-34bc-4b23-9a94-9cd1bea7ca6c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:05.589511 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-77986e5a-34bc-4b23-9a94-9cd1bea7ca6c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:05.590004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-77986e5a-34bc-4b23-9a94-9cd1bea7ca6c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:05.606658 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-77986e5a-34bc-4b23-9a94-9cd1bea7ca6c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] HTTP exception thrown: Instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c could not be found. Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-77986e5a-34bc-4b23-9a94-9cd1bea7ca6c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Request method failure captured: Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c HTTP/1.1 Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xpp-yfRd4vxcbAC1LV_HsuI5DQYuwH8uzR5I_ZFqIN1W_KbKVG1up2SCu_gxO9I33d24jB_zsPaKy5Z52cvovqQRAqGY9P4z5KA9vwYaZkOzBUBHvaaR-PlxRwoTMziFQmA0TtR4_8PjuYP7yeOJ7s8uh6-l5ZffZ3NdGkY-wPIFPk Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 3dcf50fca2134c84812de75fed624869 Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-TestMinimumBasicScenario-401178554 Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 21:01:05.608351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 21:01:05.609980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3dcf50fca2134c84812de75fed624869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3dcf50fca2134c84812de75fed624869"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3dcf50fca2134c84812de75fed624869"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3dcf50fca2134c84812de75fed624869", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 21:01:05.609980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-TestMinimumBasicScenario-401178554 Jul 19 21:01:05.609980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 3dcf50fca2134c84812de75fed624869 Jul 19 21:01:05.609980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-TestMinimumBasicScenario-401178554 Jul 19 21:01:05.609980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-TestMinimumBasicScenario-401178554-project Jul 19 21:01:05.609980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 21:01:05.609980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 21:01:05.609980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: c0bbce46598c465bb29cb0353f10e3eb Jul 19 21:01:05.609980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-TestMinimumBasicScenario-401178554-project Jul 19 21:01:05.609980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 21:01:05.609980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c could not be found. Jul 19 21:01:05.609980 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '7ebc1845-f1c0-4b88-b056-045377c6ef1c'} Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c could not be found. Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:01:05.610882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c could not be found. Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c could not be found. Jul 19 21:01:05.612324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:01:05.614832 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-77986e5a-34bc-4b23-9a94-9cd1bea7ca6c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Returning 404 to user: Instance 7ebc1845-f1c0-4b88-b056-045377c6ef1c could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:01:05.614832 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-77986e5a-34bc-4b23-9a94-9cd1bea7ca6c tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c" status: 404 len: 111 microversion: 2.1 time: 0.035593 Jul 19 21:01:05.614832 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 451/935] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:05 2022] GET /compute/v2.1/servers/7ebc1845-f1c0-4b88-b056-045377c6ef1c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:01:05.618804 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-cadc4ff0-49a7-46b6-942f-1a4a1ef0dc1d tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] Calling method '.version_select at 0x7f25276a1ca0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:05.643935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-cadc4ff0-49a7-46b6-942f-1a4a1ef0dc1d tempest-TestMinimumBasicScenario-401178554 tempest-TestMinimumBasicScenario-401178554-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1525586410" status: 202 len: 0 microversion: 2.1 time: 0.028992 Jul 19 21:01:05.645258 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 485/936] 10.222.0.70 () {58 vars in 1271 bytes} [Tue Jul 19 21:01:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1525586410 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:01:19.309848 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:19.312022 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:19.614644 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8b3879fb-5b81-48f5-bb6d-f617701a46ab tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Action: 'create', calling method: .version_select at 0x7f25341a9a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-286713671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnulE/uYgI1rgctIw24oMUheoEMf6yVUIZ3/7O0DmmGr0T4LstQfPFuOym4CJn1IEX3VaA5l3pb0hjOzaMFOjQ39x2nQVmS8nd89sl3S7ST79KjnE3fzqsM/FBnwD5EaA=="}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:19.638720 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-8b3879fb-5b81-48f5-bb6d-f617701a46ab tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Getting quotas for project 60fdf04148f548f1b9fe86ed038e839f. Resources: {'key_pairs'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:01:19.643117 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-8b3879fb-5b81-48f5-bb6d-f617701a46ab tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Getting quotas for user cf1d05ee73d4414eb51e2a7be838e28f and project 60fdf04148f548f1b9fe86ed038e839f. Resources: {'key_pairs'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:01:19.672182 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8b3879fb-5b81-48f5-bb6d-f617701a46ab tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.368170 Jul 19 21:01:19.692850 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 452/937] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jul 19 21:01:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:44.939841 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:44.940595 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:44.944527 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-315329095", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-286713671", "security_groups": [{"name": "tempest-secgroup-smoke-1787866983"}], "block_device_mapping_v2": [{"uuid": "af0bd2ff-bf47-471b-8e90-0ffc46d4df03", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "231fd8b6-2aae-45bf-aa90-12b047385fb7"}]}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:45.060173 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.network.neutron [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] validate_networks() for [('231fd8b6-2aae-45bf-aa90-12b047385fb7', None, None, None, None, None)] {{(pid=129866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:01:45.602405 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Flavor limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:01:45.602880 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Image limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:01:45.603421 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Flavor pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:01:45.603853 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Image pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:01:45.604256 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:01:45.613120 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:45.613605 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:45.614391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:45.614822 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:45.631253 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Getting quotas for project 60fdf04148f548f1b9fe86ed038e839f. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:01:45.635163 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Getting quotas for user cf1d05ee73d4414eb51e2a7be838e28f and project 60fdf04148f548f1b9fe86ed038e839f. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:01:45.696954 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Going to run 1 instances... {{(pid=129866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:01:45.700300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af0bd2ff-bf47-471b-8e90-0ffc46d4df03',volume_size=None,volume_type=None)] {{(pid=129866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:01:45.829767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-bd4c6eef-a4f0-46a2-9328-4147a5588726 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.891235 Jul 19 21:01:45.830422 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 486/938] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 21:01:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:01:45.838032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=4 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:45.839975 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:45.844495 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-be572283-1575-4214-a0fc-516806e3094f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:45.845426 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-be572283-1575-4214-a0fc-516806e3094f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:45.909581 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-be572283-1575-4214-a0fc-516806e3094f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:45.917663 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-be572283-1575-4214-a0fc-516806e3094f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1093 microversion: 2.1 time: 0.080594 Jul 19 21:01:45.927333 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 453/939] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:45 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:46.934427 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0884efbd-ad45-41de-bb77-28e8006220bf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:46.935024 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0884efbd-ad45-41de-bb77-28e8006220bf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:46.942999 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0884efbd-ad45-41de-bb77-28e8006220bf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:46.943493 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0884efbd-ad45-41de-bb77-28e8006220bf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:46.944576 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0884efbd-ad45-41de-bb77-28e8006220bf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:46.945022 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0884efbd-ad45-41de-bb77-28e8006220bf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:47.024047 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0884efbd-ad45-41de-bb77-28e8006220bf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:47.032942 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0884efbd-ad45-41de-bb77-28e8006220bf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1199 microversion: 2.1 time: 0.102520 Jul 19 21:01:47.033711 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 487/940] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:46 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1199 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:48.049774 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f813a2e2-b694-46bb-b124-c762aea418c1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:48.050385 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f813a2e2-b694-46bb-b124-c762aea418c1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:48.057308 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f813a2e2-b694-46bb-b124-c762aea418c1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:48.057868 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f813a2e2-b694-46bb-b124-c762aea418c1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:48.059449 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f813a2e2-b694-46bb-b124-c762aea418c1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:48.059902 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f813a2e2-b694-46bb-b124-c762aea418c1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:48.198114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f813a2e2-b694-46bb-b124-c762aea418c1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:48.206021 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f813a2e2-b694-46bb-b124-c762aea418c1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1277 microversion: 2.1 time: 0.160344 Jul 19 21:01:48.206614 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 454/941] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:48 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:48.949419 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-c5c5679a-a26e-47ea-80dc-0ec482e45356 req-25bba217-d42f-4340-8df6-d0f1106b8f70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff", "tag": "7cb37530-c58e-43a7-af6e-c01992fdd5fd"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:48.962900 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-c5c5679a-a26e-47ea-80dc-0ec482e45356 req-25bba217-d42f-4340-8df6-d0f1106b8f70 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:48.963351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-c5c5679a-a26e-47ea-80dc-0ec482e45356 req-25bba217-d42f-4340-8df6-d0f1106b8f70 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:48.980070 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-c5c5679a-a26e-47ea-80dc-0ec482e45356 req-25bba217-d42f-4340-8df6-d0f1106b8f70 service nova] Creating event network-changed:7cb37530-c58e-43a7-af6e-c01992fdd5fd for instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff on hv-cinder-79987 Jul 19 21:01:48.985737 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-c5c5679a-a26e-47ea-80dc-0ec482e45356 req-25bba217-d42f-4340-8df6-d0f1106b8f70 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043064 Jul 19 21:01:48.986345 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 488/942] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:49.225604 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b83cdd1c-d617-429d-af57-28e41b2518ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:49.226171 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b83cdd1c-d617-429d-af57-28e41b2518ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:49.233335 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b83cdd1c-d617-429d-af57-28e41b2518ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:49.233814 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b83cdd1c-d617-429d-af57-28e41b2518ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:49.234586 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b83cdd1c-d617-429d-af57-28e41b2518ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:49.235015 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b83cdd1c-d617-429d-af57-28e41b2518ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:49.389268 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b83cdd1c-d617-429d-af57-28e41b2518ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:49.399788 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b83cdd1c-d617-429d-af57-28e41b2518ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1277 microversion: 2.1 time: 0.178375 Jul 19 21:01:49.400554 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 455/943] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:49 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:50.421258 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dcef50a7-6168-4102-b6a1-7d12eb7b5ae9 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:50.422391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-dcef50a7-6168-4102-b6a1-7d12eb7b5ae9 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:50.429935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dcef50a7-6168-4102-b6a1-7d12eb7b5ae9 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:50.430390 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dcef50a7-6168-4102-b6a1-7d12eb7b5ae9 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:50.431229 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dcef50a7-6168-4102-b6a1-7d12eb7b5ae9 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:50.431677 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dcef50a7-6168-4102-b6a1-7d12eb7b5ae9 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:50.610584 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dcef50a7-6168-4102-b6a1-7d12eb7b5ae9 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:50.618829 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dcef50a7-6168-4102-b6a1-7d12eb7b5ae9 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1277 microversion: 2.1 time: 0.204087 Jul 19 21:01:50.619460 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 489/944] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:50 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:51.648220 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-381ca0f9-f74b-42cf-8b68-a638e3ef1bcb tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:51.649465 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-381ca0f9-f74b-42cf-8b68-a638e3ef1bcb tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:51.662337 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-381ca0f9-f74b-42cf-8b68-a638e3ef1bcb tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:51.663148 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-381ca0f9-f74b-42cf-8b68-a638e3ef1bcb tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:51.664584 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-381ca0f9-f74b-42cf-8b68-a638e3ef1bcb tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:51.665430 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-381ca0f9-f74b-42cf-8b68-a638e3ef1bcb tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:51.847844 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-381ca0f9-f74b-42cf-8b68-a638e3ef1bcb tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:51.856975 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-381ca0f9-f74b-42cf-8b68-a638e3ef1bcb tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1277 microversion: 2.1 time: 0.218754 Jul 19 21:01:51.857603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 456/945] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:51 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:52.875412 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-e59bbb0a-a0ba-4da7-a920-74177f54eb21 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:52.876052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-e59bbb0a-a0ba-4da7-a920-74177f54eb21 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:52.885283 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e59bbb0a-a0ba-4da7-a920-74177f54eb21 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:52.886135 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e59bbb0a-a0ba-4da7-a920-74177f54eb21 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:52.887159 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e59bbb0a-a0ba-4da7-a920-74177f54eb21 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:52.887591 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-e59bbb0a-a0ba-4da7-a920-74177f54eb21 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:53.037160 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-e59bbb0a-a0ba-4da7-a920-74177f54eb21 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:53.046427 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-e59bbb0a-a0ba-4da7-a920-74177f54eb21 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1265 microversion: 2.1 time: 0.175227 Jul 19 21:01:53.047089 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 490/946] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:52 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:54.064629 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-3af4de2a-2299-4b2b-8cd5-9934cc41dacf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:54.065261 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-3af4de2a-2299-4b2b-8cd5-9934cc41dacf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:54.072358 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3af4de2a-2299-4b2b-8cd5-9934cc41dacf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:54.072871 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3af4de2a-2299-4b2b-8cd5-9934cc41dacf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:54.074507 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3af4de2a-2299-4b2b-8cd5-9934cc41dacf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:54.075048 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3af4de2a-2299-4b2b-8cd5-9934cc41dacf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:54.218562 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3af4de2a-2299-4b2b-8cd5-9934cc41dacf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:54.226561 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-3af4de2a-2299-4b2b-8cd5-9934cc41dacf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1265 microversion: 2.1 time: 0.165816 Jul 19 21:01:54.227142 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 457/947] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:54 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:55.244136 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-bda9adb6-09a7-42ba-abf7-71fb8c58f95b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:55.244746 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-bda9adb6-09a7-42ba-abf7-71fb8c58f95b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:55.252505 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bda9adb6-09a7-42ba-abf7-71fb8c58f95b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:55.252985 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bda9adb6-09a7-42ba-abf7-71fb8c58f95b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:55.253900 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bda9adb6-09a7-42ba-abf7-71fb8c58f95b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:55.254548 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bda9adb6-09a7-42ba-abf7-71fb8c58f95b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:55.419061 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-bda9adb6-09a7-42ba-abf7-71fb8c58f95b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:55.427233 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-bda9adb6-09a7-42ba-abf7-71fb8c58f95b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1265 microversion: 2.1 time: 0.187366 Jul 19 21:01:55.427822 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 491/948] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:55 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:56.444191 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b5a0f97d-3d7d-4695-8a5d-e019cef06840 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:56.444837 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b5a0f97d-3d7d-4695-8a5d-e019cef06840 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:56.447298 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:56.453867 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5a0f97d-3d7d-4695-8a5d-e019cef06840 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:56.454317 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5a0f97d-3d7d-4695-8a5d-e019cef06840 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:56.455102 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5a0f97d-3d7d-4695-8a5d-e019cef06840 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:56.455543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5a0f97d-3d7d-4695-8a5d-e019cef06840 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:56.618539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b5a0f97d-3d7d-4695-8a5d-e019cef06840 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:56.629593 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b5a0f97d-3d7d-4695-8a5d-e019cef06840 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1265 microversion: 2.1 time: 0.189204 Jul 19 21:01:56.630372 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 458/949] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:56 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:57.649814 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-45dc0579-c171-4279-a733-d973dd5a855e tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:57.651819 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-45dc0579-c171-4279-a733-d973dd5a855e tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:57.654436 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:57.655167 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=6 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:57.660905 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-45dc0579-c171-4279-a733-d973dd5a855e tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:57.661387 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-45dc0579-c171-4279-a733-d973dd5a855e tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:57.662180 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-45dc0579-c171-4279-a733-d973dd5a855e tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:57.662622 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-45dc0579-c171-4279-a733-d973dd5a855e tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:57.963810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-45dc0579-c171-4279-a733-d973dd5a855e tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:57.973995 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-45dc0579-c171-4279-a733-d973dd5a855e tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1265 microversion: 2.1 time: 0.328143 Jul 19 21:01:57.974568 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 492/950] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:57 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1265 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:58.992360 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-bea9065d-df6a-4d46-936c-c3114a851799 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:58.993392 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-bea9065d-df6a-4d46-936c-c3114a851799 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:59.006968 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bea9065d-df6a-4d46-936c-c3114a851799 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:59.007783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bea9065d-df6a-4d46-936c-c3114a851799 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:59.009390 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bea9065d-df6a-4d46-936c-c3114a851799 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:59.010853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bea9065d-df6a-4d46-936c-c3114a851799 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:59.192261 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-bea9065d-df6a-4d46-936c-c3114a851799 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:59.205841 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-bea9065d-df6a-4d46-936c-c3114a851799 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1265 microversion: 2.1 time: 0.218669 Jul 19 21:01:59.206819 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 459/951] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:58 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:00.230066 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8dc1244b-877f-4798-8a37-0bcf750992c4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:00.230959 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8dc1244b-877f-4798-8a37-0bcf750992c4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:00.237842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8dc1244b-877f-4798-8a37-0bcf750992c4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:00.238294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8dc1244b-877f-4798-8a37-0bcf750992c4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:00.239169 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8dc1244b-877f-4798-8a37-0bcf750992c4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:00.240653 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8dc1244b-877f-4798-8a37-0bcf750992c4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:00.394767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-8dc1244b-877f-4798-8a37-0bcf750992c4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:00.403652 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8dc1244b-877f-4798-8a37-0bcf750992c4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1265 microversion: 2.1 time: 0.178190 Jul 19 21:02:00.404225 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 493/952] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:00 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:01.421486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-47f1da49-6494-4b5e-9c93-8240429ae328 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:01.422084 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-47f1da49-6494-4b5e-9c93-8240429ae328 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:01.429445 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-47f1da49-6494-4b5e-9c93-8240429ae328 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:01.429879 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-47f1da49-6494-4b5e-9c93-8240429ae328 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:01.430673 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-47f1da49-6494-4b5e-9c93-8240429ae328 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:01.431121 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-47f1da49-6494-4b5e-9c93-8240429ae328 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:01.613798 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-47f1da49-6494-4b5e-9c93-8240429ae328 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:01.623388 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-47f1da49-6494-4b5e-9c93-8240429ae328 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1265 microversion: 2.1 time: 0.206640 Jul 19 21:02:01.624503 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 460/953] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:01 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:02.649331 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7a86a5ce-1832-458c-97fd-e01debd458d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:02.649995 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-7a86a5ce-1832-458c-97fd-e01debd458d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:02.658421 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7a86a5ce-1832-458c-97fd-e01debd458d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:02.658867 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7a86a5ce-1832-458c-97fd-e01debd458d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:02.659650 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7a86a5ce-1832-458c-97fd-e01debd458d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:02.660090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7a86a5ce-1832-458c-97fd-e01debd458d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:02.844297 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-7a86a5ce-1832-458c-97fd-e01debd458d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:02.852524 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-7a86a5ce-1832-458c-97fd-e01debd458d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1265 microversion: 2.1 time: 0.207062 Jul 19 21:02:02.853063 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 494/954] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:02 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:03.275655 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-a7e4fade-b850-4328-bea8-12a9973ce0d4 req-c1541393-a50c-4223-a5a7-6c12edd98077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff", "name": "network-vif-plugged", "status": "completed", "tag": "7cb37530-c58e-43a7-af6e-c01992fdd5fd"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:03.285092 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-a7e4fade-b850-4328-bea8-12a9973ce0d4 req-c1541393-a50c-4223-a5a7-6c12edd98077 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:03.285574 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-a7e4fade-b850-4328-bea8-12a9973ce0d4 req-c1541393-a50c-4223-a5a7-6c12edd98077 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:03.299122 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-a7e4fade-b850-4328-bea8-12a9973ce0d4 req-c1541393-a50c-4223-a5a7-6c12edd98077 service nova] Creating event network-vif-plugged:7cb37530-c58e-43a7-af6e-c01992fdd5fd for instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff on hv-cinder-79987 Jul 19 21:02:03.304619 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-a7e4fade-b850-4328-bea8-12a9973ce0d4 req-c1541393-a50c-4223-a5a7-6c12edd98077 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220132 Jul 19 21:02:03.305451 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 461/955] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:02:03.870692 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6cb80dce-17b9-4be9-a8a1-88f81e0bc519 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:03.871397 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6cb80dce-17b9-4be9-a8a1-88f81e0bc519 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:03.878523 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6cb80dce-17b9-4be9-a8a1-88f81e0bc519 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:03.878968 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6cb80dce-17b9-4be9-a8a1-88f81e0bc519 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:03.879762 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6cb80dce-17b9-4be9-a8a1-88f81e0bc519 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:03.880442 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6cb80dce-17b9-4be9-a8a1-88f81e0bc519 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:04.037372 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6cb80dce-17b9-4be9-a8a1-88f81e0bc519 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:04.045753 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6cb80dce-17b9-4be9-a8a1-88f81e0bc519 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1265 microversion: 2.1 time: 0.179407 Jul 19 21:02:04.046339 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 495/956] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:03 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:05.064744 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ef74fde8-f9a3-4b1e-8ff9-3fbde586de8a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:05.065478 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ef74fde8-f9a3-4b1e-8ff9-3fbde586de8a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:05.072815 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ef74fde8-f9a3-4b1e-8ff9-3fbde586de8a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:05.073282 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ef74fde8-f9a3-4b1e-8ff9-3fbde586de8a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:05.074127 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ef74fde8-f9a3-4b1e-8ff9-3fbde586de8a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:05.074574 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ef74fde8-f9a3-4b1e-8ff9-3fbde586de8a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:05.238645 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ef74fde8-f9a3-4b1e-8ff9-3fbde586de8a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:05.247658 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ef74fde8-f9a3-4b1e-8ff9-3fbde586de8a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1451 microversion: 2.1 time: 0.187127 Jul 19 21:02:05.248260 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 462/957] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:05 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1451 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:05.265216 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-40fc9822-5343-4159-b37a-456ef1f73c60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:05.265933 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-40fc9822-5343-4159-b37a-456ef1f73c60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:05.273679 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-40fc9822-5343-4159-b37a-456ef1f73c60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:05.274232 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-40fc9822-5343-4159-b37a-456ef1f73c60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:05.274929 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-40fc9822-5343-4159-b37a-456ef1f73c60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:05.275374 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-40fc9822-5343-4159-b37a-456ef1f73c60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:05.436005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-40fc9822-5343-4159-b37a-456ef1f73c60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:05.443969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-40fc9822-5343-4159-b37a-456ef1f73c60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1451 microversion: 2.1 time: 0.183531 Jul 19 21:02:05.444553 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 496/958] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:05 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1451 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:07.735064 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-9fedf6c6-d643-4385-b97f-31c3818ef5c5 req-887bcbf7-b5be-4b19-aa68-23154f685755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff", "tag": "7cb37530-c58e-43a7-af6e-c01992fdd5fd"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:07.754172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-9fedf6c6-d643-4385-b97f-31c3818ef5c5 req-887bcbf7-b5be-4b19-aa68-23154f685755 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:07.755272 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-9fedf6c6-d643-4385-b97f-31c3818ef5c5 req-887bcbf7-b5be-4b19-aa68-23154f685755 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:07.778295 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-9fedf6c6-d643-4385-b97f-31c3818ef5c5 req-887bcbf7-b5be-4b19-aa68-23154f685755 service nova] Creating event network-changed:7cb37530-c58e-43a7-af6e-c01992fdd5fd for instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff on hv-cinder-79987 Jul 19 21:02:07.787989 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-9fedf6c6-d643-4385-b97f-31c3818ef5c5 req-887bcbf7-b5be-4b19-aa68-23154f685755 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061043 Jul 19 21:02:07.789090 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 463/959] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:25.880015 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1854552609", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "networks": [{"uuid": "53829d6a-daf0-4ee4-a734-9beb713c2c1c"}]}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:25.888105 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:25.888767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=58 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:25.936440 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.network.neutron [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] validate_networks() for [('53829d6a-daf0-4ee4-a734-9beb713c2c1c', None, None, None, None, None)] {{(pid=129866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:02:26.573942 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Flavor limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:02:26.574378 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Image limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:02:26.575028 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Flavor pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:02:26.575581 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Image pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:02:26.576145 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:02:26.590434 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:26.590888 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:26.591948 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:26.592429 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:26.613508 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Getting quotas for project 44d7d00a1ff0437cb7fc46658c3a1f79. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:02:26.618716 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Getting quotas for user a02317457dae42069b86da4bd35278b4 and project 44d7d00a1ff0437cb7fc46658c3a1f79. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:02:26.632269 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Going to run 1 instances... {{(pid=129866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:02:26.634691 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:02:26.688775 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3feefc2c-6063-4dfa-b3b1-5b7e8815bb7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812544 Jul 19 21:02:26.689455 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 497/960] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 21:02:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:02:26.707727 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9c6eff63-ac4f-427c-afec-1547a4bd14b8 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:26.708735 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9c6eff63-ac4f-427c-afec-1547a4bd14b8 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:26.712780 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=24 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:26.712780 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=52 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:26.789705 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9c6eff63-ac4f-427c-afec-1547a4bd14b8 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:26.796574 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9c6eff63-ac4f-427c-afec-1547a4bd14b8 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1219 microversion: 2.1 time: 0.097654 Jul 19 21:02:26.797158 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 464/961] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:26 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:27.818821 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5da80bf5-de35-4901-b800-a34f7165917f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:27.819934 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5da80bf5-de35-4901-b800-a34f7165917f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:27.831626 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5da80bf5-de35-4901-b800-a34f7165917f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:27.832420 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5da80bf5-de35-4901-b800-a34f7165917f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:27.833338 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5da80bf5-de35-4901-b800-a34f7165917f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:27.833935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5da80bf5-de35-4901-b800-a34f7165917f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:27.910083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5da80bf5-de35-4901-b800-a34f7165917f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:27.919160 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5da80bf5-de35-4901-b800-a34f7165917f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1279 microversion: 2.1 time: 0.108460 Jul 19 21:02:27.919731 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 498/962] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:27 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1279 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:28.936705 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-3157107b-49fa-409e-80a9-14db6ba9cd34 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:28.937324 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-3157107b-49fa-409e-80a9-14db6ba9cd34 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:28.944033 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3157107b-49fa-409e-80a9-14db6ba9cd34 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:28.944492 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3157107b-49fa-409e-80a9-14db6ba9cd34 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:28.945272 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3157107b-49fa-409e-80a9-14db6ba9cd34 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:28.945751 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-3157107b-49fa-409e-80a9-14db6ba9cd34 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:28.966861 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:02:28.968351 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Tue Jul 19 21:02:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 (ip 10.222.0.70) !!! Jul 19 21:02:29.107569 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-3157107b-49fa-409e-80a9-14db6ba9cd34 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:29.117523 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-3157107b-49fa-409e-80a9-14db6ba9cd34 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1319 microversion: 2.1 time: 0.184656 Jul 19 21:02:29.118291 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 465/963] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:28 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:29.256385 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-1aa5d4e3-8db2-4b88-a84b-5fc38e1600a7 req-b7b6bc05-b170-48ec-8a5d-e6edbde9b5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87b48e6-38bb-4dc4-8cfb-efb89b2b3589", "tag": "cab3f7d5-f79d-4719-a67f-d252a366a83e"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:29.271051 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-1aa5d4e3-8db2-4b88-a84b-5fc38e1600a7 req-b7b6bc05-b170-48ec-8a5d-e6edbde9b5b7 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:29.271642 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-1aa5d4e3-8db2-4b88-a84b-5fc38e1600a7 req-b7b6bc05-b170-48ec-8a5d-e6edbde9b5b7 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:29.287032 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-1aa5d4e3-8db2-4b88-a84b-5fc38e1600a7 req-b7b6bc05-b170-48ec-8a5d-e6edbde9b5b7 service nova] Creating event network-changed:cab3f7d5-f79d-4719-a67f-d252a366a83e for instance a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 on hv-cinder-79987 Jul 19 21:02:29.293405 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-1aa5d4e3-8db2-4b88-a84b-5fc38e1600a7 req-b7b6bc05-b170-48ec-8a5d-e6edbde9b5b7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042693 Jul 19 21:02:29.293956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 499/964] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:30.140991 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-488f7d4a-3acf-4cd6-b0a3-90b1a609c7cb tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:30.141614 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-488f7d4a-3acf-4cd6-b0a3-90b1a609c7cb tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:30.148242 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-488f7d4a-3acf-4cd6-b0a3-90b1a609c7cb tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:30.148690 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-488f7d4a-3acf-4cd6-b0a3-90b1a609c7cb tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:30.149479 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-488f7d4a-3acf-4cd6-b0a3-90b1a609c7cb tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:30.149918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-488f7d4a-3acf-4cd6-b0a3-90b1a609c7cb tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:30.285024 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-488f7d4a-3acf-4cd6-b0a3-90b1a609c7cb tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:30.293466 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-488f7d4a-3acf-4cd6-b0a3-90b1a609c7cb tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1319 microversion: 2.1 time: 0.156276 Jul 19 21:02:30.294068 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 466/965] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:30 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:31.314060 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-a375c374-405c-4e9f-af44-6585f767ff28 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:31.314900 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-a375c374-405c-4e9f-af44-6585f767ff28 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:31.323728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a375c374-405c-4e9f-af44-6585f767ff28 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:31.324332 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a375c374-405c-4e9f-af44-6585f767ff28 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:31.325143 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a375c374-405c-4e9f-af44-6585f767ff28 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:31.325609 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-a375c374-405c-4e9f-af44-6585f767ff28 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:31.479887 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-a375c374-405c-4e9f-af44-6585f767ff28 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:31.488318 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-a375c374-405c-4e9f-af44-6585f767ff28 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1319 microversion: 2.1 time: 0.181348 Jul 19 21:02:31.489059 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 500/966] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:31 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:32.508322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-56d7ba83-918c-4172-8a4f-61140f75f52b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:32.509845 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-56d7ba83-918c-4172-8a4f-61140f75f52b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:32.517781 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-56d7ba83-918c-4172-8a4f-61140f75f52b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:32.518240 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-56d7ba83-918c-4172-8a4f-61140f75f52b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:32.519037 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-56d7ba83-918c-4172-8a4f-61140f75f52b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:32.519518 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-56d7ba83-918c-4172-8a4f-61140f75f52b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:32.721899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-56d7ba83-918c-4172-8a4f-61140f75f52b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:32.736335 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-56d7ba83-918c-4172-8a4f-61140f75f52b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1319 microversion: 2.1 time: 0.233290 Jul 19 21:02:32.737370 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 467/967] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:32 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:33.756507 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-6520ec75-7c13-41d8-94d6-f656bc2fa672 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:33.757300 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-6520ec75-7c13-41d8-94d6-f656bc2fa672 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:33.768671 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6520ec75-7c13-41d8-94d6-f656bc2fa672 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:33.769137 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6520ec75-7c13-41d8-94d6-f656bc2fa672 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:33.770081 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6520ec75-7c13-41d8-94d6-f656bc2fa672 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:33.770600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-6520ec75-7c13-41d8-94d6-f656bc2fa672 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:33.960165 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-6520ec75-7c13-41d8-94d6-f656bc2fa672 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:33.968743 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-6520ec75-7c13-41d8-94d6-f656bc2fa672 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1319 microversion: 2.1 time: 0.217020 Jul 19 21:02:33.969341 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 501/968] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:33 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:34.990975 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f1bebb7f-60ab-4b4d-840d-2bffe64fa9bd tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:34.991983 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f1bebb7f-60ab-4b4d-840d-2bffe64fa9bd tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:35.000156 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1bebb7f-60ab-4b4d-840d-2bffe64fa9bd tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:35.000712 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1bebb7f-60ab-4b4d-840d-2bffe64fa9bd tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:35.001877 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1bebb7f-60ab-4b4d-840d-2bffe64fa9bd tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:35.002334 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1bebb7f-60ab-4b4d-840d-2bffe64fa9bd tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:35.177228 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f1bebb7f-60ab-4b4d-840d-2bffe64fa9bd tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:35.187416 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f1bebb7f-60ab-4b4d-840d-2bffe64fa9bd tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1319 microversion: 2.1 time: 0.200202 Jul 19 21:02:35.188667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 468/969] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:34 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:35.376977 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-564157c2-1c5b-4db4-b311-ff43746975b0 req-4f6fc8a8-f86d-40a3-a90a-c56f91eda172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87b48e6-38bb-4dc4-8cfb-efb89b2b3589", "name": "network-vif-plugged", "status": "completed", "tag": "cab3f7d5-f79d-4719-a67f-d252a366a83e"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:35.389688 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-564157c2-1c5b-4db4-b311-ff43746975b0 req-4f6fc8a8-f86d-40a3-a90a-c56f91eda172 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:35.390219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-564157c2-1c5b-4db4-b311-ff43746975b0 req-4f6fc8a8-f86d-40a3-a90a-c56f91eda172 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:35.403263 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-564157c2-1c5b-4db4-b311-ff43746975b0 req-4f6fc8a8-f86d-40a3-a90a-c56f91eda172 service nova] Creating event network-vif-plugged:cab3f7d5-f79d-4719-a67f-d252a366a83e for instance a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 on hv-cinder-79987 Jul 19 21:02:35.408326 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-564157c2-1c5b-4db4-b311-ff43746975b0 req-4f6fc8a8-f86d-40a3-a90a-c56f91eda172 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039144 Jul 19 21:02:35.409036 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 502/970] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:02:36.208463 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-02f366fd-dc2c-4834-b32f-0e4e78916243 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:36.209016 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-02f366fd-dc2c-4834-b32f-0e4e78916243 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:36.216756 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-02f366fd-dc2c-4834-b32f-0e4e78916243 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:36.217209 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-02f366fd-dc2c-4834-b32f-0e4e78916243 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:36.218024 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-02f366fd-dc2c-4834-b32f-0e4e78916243 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:36.218458 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-02f366fd-dc2c-4834-b32f-0e4e78916243 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:36.359764 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-02f366fd-dc2c-4834-b32f-0e4e78916243 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:36.368227 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-02f366fd-dc2c-4834-b32f-0e4e78916243 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1319 microversion: 2.1 time: 0.163804 Jul 19 21:02:36.368820 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 469/971] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:36 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:37.388622 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:37.389970 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=6 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:37.394729 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3f64364d-6ade-44a3-a56f-4c58e4abd835 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:37.395491 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3f64364d-6ade-44a3-a56f-4c58e4abd835 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:37.404118 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3f64364d-6ade-44a3-a56f-4c58e4abd835 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:37.404494 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3f64364d-6ade-44a3-a56f-4c58e4abd835 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:37.405301 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3f64364d-6ade-44a3-a56f-4c58e4abd835 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:37.405802 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3f64364d-6ade-44a3-a56f-4c58e4abd835 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:37.568494 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-3f64364d-6ade-44a3-a56f-4c58e4abd835 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:37.577415 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3f64364d-6ade-44a3-a56f-4c58e4abd835 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1508 microversion: 2.1 time: 0.190080 Jul 19 21:02:37.577998 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 503/972] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:37 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:59.218774 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-28d0813d-df18-4afc-a878-b2a10e63bb43 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9e6d929-230f-4b55-a018-cd38169dc4f6", "device": "/dev/sdb"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:59.220676 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-28d0813d-df18-4afc-a878-b2a10e63bb43 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:59.222746 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:59.223464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=14 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:59.224091 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=30 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:59.230396 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-28d0813d-df18-4afc-a878-b2a10e63bb43 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:59.230846 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-28d0813d-df18-4afc-a878-b2a10e63bb43 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:59.231618 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-28d0813d-df18-4afc-a878-b2a10e63bb43 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:59.232058 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-28d0813d-df18-4afc-a878-b2a10e63bb43 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:59.480840 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-28d0813d-df18-4afc-a878-b2a10e63bb43 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "POST /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266498 Jul 19 21:02:59.481598 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 470/973] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 21:02:59 2022] POST /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:26.279196 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-fdae6d78-1b34-4cf9-b808-74ef215721f6 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:26.279727 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-fdae6d78-1b34-4cf9-b808-74ef215721f6 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:26.281820 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:26.282571 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=30 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:26.289083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fdae6d78-1b34-4cf9-b808-74ef215721f6 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:26.289567 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fdae6d78-1b34-4cf9-b808-74ef215721f6 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:26.290336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fdae6d78-1b34-4cf9-b808-74ef215721f6 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:26.290771 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fdae6d78-1b34-4cf9-b808-74ef215721f6 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:26.376699 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-fdae6d78-1b34-4cf9-b808-74ef215721f6 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lazy-loading 'services' on Instance uuid a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:03:26.462351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-fdae6d78-1b34-4cf9-b808-74ef215721f6 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589/os-volume_attachments/a9e6d929-230f-4b55-a018-cd38169dc4f6" status: 202 len: 0 microversion: 2.1 time: 0.186422 Jul 19 21:03:26.463179 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 504/974] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jul 19 21:03:26 2022] DELETE /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589/os-volume_attachments/a9e6d929-230f-4b55-a018-cd38169dc4f6 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:03:27.591657 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:27.592429 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:27.597852 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-c9f82b35-9f2c-4129-985f-75b40ecb3423 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:27.598489 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c9f82b35-9f2c-4129-985f-75b40ecb3423 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:27.606799 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c9f82b35-9f2c-4129-985f-75b40ecb3423 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:27.607248 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c9f82b35-9f2c-4129-985f-75b40ecb3423 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:27.608023 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c9f82b35-9f2c-4129-985f-75b40ecb3423 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:27.608955 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-c9f82b35-9f2c-4129-985f-75b40ecb3423 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:27.644378 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-c9f82b35-9f2c-4129-985f-75b40ecb3423 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:03:27.728420 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-c9f82b35-9f2c-4129-985f-75b40ecb3423 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 204 len: 0 microversion: 2.1 time: 0.137895 Jul 19 21:03:27.729083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 471/975] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 21:03:27 2022] DELETE /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:03:27.741275 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-567ec35f-2e51-48c3-b946-55fa6e9cddc5 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:27.742382 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-567ec35f-2e51-48c3-b946-55fa6e9cddc5 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:27.748916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-567ec35f-2e51-48c3-b946-55fa6e9cddc5 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:27.749537 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-567ec35f-2e51-48c3-b946-55fa6e9cddc5 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:27.750312 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-567ec35f-2e51-48c3-b946-55fa6e9cddc5 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:27.750788 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-567ec35f-2e51-48c3-b946-55fa6e9cddc5 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:27.902454 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-567ec35f-2e51-48c3-b946-55fa6e9cddc5 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:27.910833 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-567ec35f-2e51-48c3-b946-55fa6e9cddc5 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1514 microversion: 2.1 time: 0.175972 Jul 19 21:03:27.911402 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 505/976] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:27 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:03:28.931714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b91b45a4-8c66-4339-9570-375a0a37f84d tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:28.932418 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b91b45a4-8c66-4339-9570-375a0a37f84d tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:28.939139 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b91b45a4-8c66-4339-9570-375a0a37f84d tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:28.939599 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b91b45a4-8c66-4339-9570-375a0a37f84d tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:28.940372 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b91b45a4-8c66-4339-9570-375a0a37f84d tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:28.940812 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b91b45a4-8c66-4339-9570-375a0a37f84d tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:29.081101 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b91b45a4-8c66-4339-9570-375a0a37f84d tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:29.089019 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b91b45a4-8c66-4339-9570-375a0a37f84d tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1514 microversion: 2.1 time: 0.161556 Jul 19 21:03:29.089640 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 472/977] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:28 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:03:30.108134 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-cfbc8909-b0f5-467c-9c0b-174038cd968b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:30.109602 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-cfbc8909-b0f5-467c-9c0b-174038cd968b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:30.116550 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cfbc8909-b0f5-467c-9c0b-174038cd968b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:30.117703 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cfbc8909-b0f5-467c-9c0b-174038cd968b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:30.118451 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cfbc8909-b0f5-467c-9c0b-174038cd968b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:30.118906 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cfbc8909-b0f5-467c-9c0b-174038cd968b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:30.176777 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-93c8af26-0cd3-4e3a-bf1d-ef7de5d09822 req-4147a38a-d7c1-4678-b13b-3c229e89b4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87b48e6-38bb-4dc4-8cfb-efb89b2b3589", "name": "network-vif-deleted", "tag": "cab3f7d5-f79d-4719-a67f-d252a366a83e"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:30.186831 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-93c8af26-0cd3-4e3a-bf1d-ef7de5d09822 req-4147a38a-d7c1-4678-b13b-3c229e89b4bf service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:30.187639 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-93c8af26-0cd3-4e3a-bf1d-ef7de5d09822 req-4147a38a-d7c1-4678-b13b-3c229e89b4bf service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:30.197403 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-cfbc8909-b0f5-467c-9c0b-174038cd968b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:30.206449 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-93c8af26-0cd3-4e3a-bf1d-ef7de5d09822 req-4147a38a-d7c1-4678-b13b-3c229e89b4bf service nova] Creating event network-vif-deleted:cab3f7d5-f79d-4719-a67f-d252a366a83e for instance a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 on hv-cinder-79987 Jul 19 21:03:30.207328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-cfbc8909-b0f5-467c-9c0b-174038cd968b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 200 len: 1472 microversion: 2.1 time: 0.103232 Jul 19 21:03:30.207916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 506/978] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:30 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 1472 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:30.220723 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-93c8af26-0cd3-4e3a-bf1d-ef7de5d09822 req-4147a38a-d7c1-4678-b13b-3c229e89b4bf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047868 Jul 19 21:03:30.221334 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 473/979] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:03:31.225317 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-894d223c-8ce9-4f7d-a980-b2586ed84ff3 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:31.226030 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-894d223c-8ce9-4f7d-a980-b2586ed84ff3 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: a87b48e6-38bb-4dc4-8cfb-efb89b2b3589] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:31.232403 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-894d223c-8ce9-4f7d-a980-b2586ed84ff3 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:31.232854 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-894d223c-8ce9-4f7d-a980-b2586ed84ff3 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:31.234143 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-894d223c-8ce9-4f7d-a980-b2586ed84ff3 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:31.234582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-894d223c-8ce9-4f7d-a980-b2586ed84ff3 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:31.247798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-894d223c-8ce9-4f7d-a980-b2586ed84ff3 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] HTTP exception thrown: Instance a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 could not be found. Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-894d223c-8ce9-4f7d-a980-b2586ed84ff3 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Request method failure captured: Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 HTTP/1.1 Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xvg2j-j0pPgOIOAOT4WXXen_pNrlITxT2MHv_xJAT6NawNOEAsog1DHGVnh3BNmH-uQbyx6gPGb-dzM69lmRnfV55ZHbiai3XUb6axWqs5_G35Jxh5OHWk9d8oY7z3tvHcBe0LCPOgMET8cbalszBwSDK_XmQaK_C8NM2s9TjLAaBo Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 44d7d00a1ff0437cb7fc46658c3a1f79 Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1824137296 Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 21:03:31.250097 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 21:03:31.251798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/44d7d00a1ff0437cb7fc46658c3a1f79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/44d7d00a1ff0437cb7fc46658c3a1f79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/44d7d00a1ff0437cb7fc46658c3a1f79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_44d7d00a1ff0437cb7fc46658c3a1f79", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 21:03:31.251798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-VolumesSnapshotTestJSON-1824137296 Jul 19 21:03:31.251798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 44d7d00a1ff0437cb7fc46658c3a1f79 Jul 19 21:03:31.251798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1824137296 Jul 19 21:03:31.251798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-VolumesSnapshotTestJSON-1824137296-project Jul 19 21:03:31.251798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 21:03:31.251798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 21:03:31.251798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: a02317457dae42069b86da4bd35278b4 Jul 19 21:03:31.251798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-VolumesSnapshotTestJSON-1824137296-project Jul 19 21:03:31.251798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 21:03:31.251798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 could not be found. Jul 19 21:03:31.251798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': 'a87b48e6-38bb-4dc4-8cfb-efb89b2b3589'} Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 could not be found. Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:03:31.253856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 could not be found. Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 could not be found. Jul 19 21:03:31.255325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:03:31.256803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-894d223c-8ce9-4f7d-a980-b2586ed84ff3 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Returning 404 to user: Instance a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:03:31.256803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-894d223c-8ce9-4f7d-a980-b2586ed84ff3 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589" status: 404 len: 111 microversion: 2.1 time: 0.030044 Jul 19 21:03:31.256803 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 507/980] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:31 2022] GET /compute/v2.1/servers/a87b48e6-38bb-4dc4-8cfb-efb89b2b3589 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:03:41.096606 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:41.097458 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:41.102336 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2118415258", "imageRef": "498164f5-59f2-41fd-9bab-b338c9a52b16", "flavorRef": "452", "networks": [{"uuid": "53829d6a-daf0-4ee4-a734-9beb713c2c1c"}]}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:41.163744 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.network.neutron [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] validate_networks() for [('53829d6a-daf0-4ee4-a734-9beb713c2c1c', None, None, None, None, None)] {{(pid=129867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:03:41.582353 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Flavor limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:03:41.582873 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Image limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:03:41.583365 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Flavor pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:03:41.583770 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Image pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:03:41.584178 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:03:41.593798 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:41.594245 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:41.595319 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:41.596038 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:41.613783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Getting quotas for project 44d7d00a1ff0437cb7fc46658c3a1f79. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:03:41.618777 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Getting quotas for user a02317457dae42069b86da4bd35278b4 and project 44d7d00a1ff0437cb7fc46658c3a1f79. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:03:41.630191 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Going to run 1 instances... {{(pid=129867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:03:41.632661 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='498164f5-59f2-41fd-9bab-b338c9a52b16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:03:41.680083 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d2c3182f-0b82-4ab4-ae22-94de7031cdba tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585223 Jul 19 21:03:41.680727 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 474/981] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 21:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:03:41.691590 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dfbaa2f4-086d-4f82-80ab-695ad9107866 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:41.692553 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-dfbaa2f4-086d-4f82-80ab-695ad9107866 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:41.695450 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=8 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:41.696400 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:41.755028 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dfbaa2f4-086d-4f82-80ab-695ad9107866 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:41.762473 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dfbaa2f4-086d-4f82-80ab-695ad9107866 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1219 microversion: 2.1 time: 0.074794 Jul 19 21:03:41.763044 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 508/982] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:41 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:42.780055 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-82dc4ec6-a1d0-4295-b65c-565bbcd19c12 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:42.780708 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-82dc4ec6-a1d0-4295-b65c-565bbcd19c12 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:42.787347 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-82dc4ec6-a1d0-4295-b65c-565bbcd19c12 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:42.787710 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-82dc4ec6-a1d0-4295-b65c-565bbcd19c12 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:42.788494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-82dc4ec6-a1d0-4295-b65c-565bbcd19c12 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:42.788925 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-82dc4ec6-a1d0-4295-b65c-565bbcd19c12 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:42.855530 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-82dc4ec6-a1d0-4295-b65c-565bbcd19c12 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:42.864319 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-82dc4ec6-a1d0-4295-b65c-565bbcd19c12 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1277 microversion: 2.1 time: 0.088516 Jul 19 21:03:42.864917 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 475/983] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:42 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:43.884357 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c024791b-d912-487d-8994-eb3b7ffba63c tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:43.885156 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c024791b-d912-487d-8994-eb3b7ffba63c tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:43.892993 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c024791b-d912-487d-8994-eb3b7ffba63c tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:43.893481 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c024791b-d912-487d-8994-eb3b7ffba63c tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:43.894532 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c024791b-d912-487d-8994-eb3b7ffba63c tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:43.894969 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c024791b-d912-487d-8994-eb3b7ffba63c tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:43.903856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-c2657aef-a14a-4669-af28-6b72141fcbbb req-24d586b3-fd23-4099-ad57-02a2cc2965a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a925f2b-e23a-4e0d-8206-8470473c5a30", "tag": "0b3c758d-9c4b-4773-9f7f-05291d2d0a80"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:43.915791 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-c2657aef-a14a-4669-af28-6b72141fcbbb req-24d586b3-fd23-4099-ad57-02a2cc2965a2 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:43.916514 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-c2657aef-a14a-4669-af28-6b72141fcbbb req-24d586b3-fd23-4099-ad57-02a2cc2965a2 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:43.930479 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-c2657aef-a14a-4669-af28-6b72141fcbbb req-24d586b3-fd23-4099-ad57-02a2cc2965a2 service nova] Creating event network-changed:0b3c758d-9c4b-4773-9f7f-05291d2d0a80 for instance 3a925f2b-e23a-4e0d-8206-8470473c5a30 on hv-cinder-79987 Jul 19 21:03:43.935639 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-c2657aef-a14a-4669-af28-6b72141fcbbb req-24d586b3-fd23-4099-ad57-02a2cc2965a2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040875 Jul 19 21:03:43.936577 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 476/984] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:44.047380 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c024791b-d912-487d-8994-eb3b7ffba63c tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:44.054982 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c024791b-d912-487d-8994-eb3b7ffba63c tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1319 microversion: 2.1 time: 0.177023 Jul 19 21:03:44.055557 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 509/985] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:43 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:45.073214 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8f4ef0c0-d8a6-418d-89a0-3ad750b48c70 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:45.073959 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8f4ef0c0-d8a6-418d-89a0-3ad750b48c70 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:45.081330 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8f4ef0c0-d8a6-418d-89a0-3ad750b48c70 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:45.081834 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8f4ef0c0-d8a6-418d-89a0-3ad750b48c70 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:45.082636 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8f4ef0c0-d8a6-418d-89a0-3ad750b48c70 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:45.083077 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8f4ef0c0-d8a6-418d-89a0-3ad750b48c70 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:45.221720 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-8f4ef0c0-d8a6-418d-89a0-3ad750b48c70 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:45.229185 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8f4ef0c0-d8a6-418d-89a0-3ad750b48c70 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1319 microversion: 2.1 time: 0.160801 Jul 19 21:03:45.229876 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 477/986] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:45 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:46.246285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b2b2abb4-b43d-4725-a5ac-871631ec3a4a tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:46.246837 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b2b2abb4-b43d-4725-a5ac-871631ec3a4a tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:46.254274 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b2b2abb4-b43d-4725-a5ac-871631ec3a4a tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:46.254717 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b2b2abb4-b43d-4725-a5ac-871631ec3a4a tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:46.255602 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b2b2abb4-b43d-4725-a5ac-871631ec3a4a tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:46.256153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b2b2abb4-b43d-4725-a5ac-871631ec3a4a tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:46.390182 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b2b2abb4-b43d-4725-a5ac-871631ec3a4a tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:46.397548 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b2b2abb4-b43d-4725-a5ac-871631ec3a4a tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1319 microversion: 2.1 time: 0.155208 Jul 19 21:03:46.398102 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 510/987] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:46 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:47.414409 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-254ed5c3-83c3-44b7-bce5-2a9fd79f422f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:47.415019 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-254ed5c3-83c3-44b7-bce5-2a9fd79f422f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:47.424921 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-254ed5c3-83c3-44b7-bce5-2a9fd79f422f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:47.425404 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-254ed5c3-83c3-44b7-bce5-2a9fd79f422f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:47.426202 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-254ed5c3-83c3-44b7-bce5-2a9fd79f422f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:47.426648 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-254ed5c3-83c3-44b7-bce5-2a9fd79f422f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:47.565539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-254ed5c3-83c3-44b7-bce5-2a9fd79f422f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:47.573544 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-254ed5c3-83c3-44b7-bce5-2a9fd79f422f tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1319 microversion: 2.1 time: 0.162885 Jul 19 21:03:47.574140 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 478/988] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:47 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:48.590660 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4c00d9f2-304d-4cfc-9a70-3cd706b1141b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:48.591276 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4c00d9f2-304d-4cfc-9a70-3cd706b1141b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:48.599271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4c00d9f2-304d-4cfc-9a70-3cd706b1141b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:48.599729 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4c00d9f2-304d-4cfc-9a70-3cd706b1141b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:48.600502 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4c00d9f2-304d-4cfc-9a70-3cd706b1141b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:48.600942 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4c00d9f2-304d-4cfc-9a70-3cd706b1141b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:48.738694 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4c00d9f2-304d-4cfc-9a70-3cd706b1141b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:48.746187 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4c00d9f2-304d-4cfc-9a70-3cd706b1141b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1319 microversion: 2.1 time: 0.159556 Jul 19 21:03:48.746742 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 511/989] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:48 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:49.606785 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-61df135a-ceef-4459-bb4c-23c1ae66804e req-3dd1ae63-f444-4b19-8e03-8f363e10e13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a925f2b-e23a-4e0d-8206-8470473c5a30", "name": "network-vif-plugged", "status": "completed", "tag": "0b3c758d-9c4b-4773-9f7f-05291d2d0a80"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:49.616416 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-61df135a-ceef-4459-bb4c-23c1ae66804e req-3dd1ae63-f444-4b19-8e03-8f363e10e13b service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:49.616939 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-61df135a-ceef-4459-bb4c-23c1ae66804e req-3dd1ae63-f444-4b19-8e03-8f363e10e13b service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:49.628449 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-61df135a-ceef-4459-bb4c-23c1ae66804e req-3dd1ae63-f444-4b19-8e03-8f363e10e13b service nova] Creating event network-vif-plugged:0b3c758d-9c4b-4773-9f7f-05291d2d0a80 for instance 3a925f2b-e23a-4e0d-8206-8470473c5a30 on hv-cinder-79987 Jul 19 21:03:49.633246 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-61df135a-ceef-4459-bb4c-23c1ae66804e req-3dd1ae63-f444-4b19-8e03-8f363e10e13b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030444 Jul 19 21:03:49.633953 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 479/990] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:49.762486 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b8e67bc8-d6fb-4bc4-9ea6-1ee320cbd940 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:49.763120 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b8e67bc8-d6fb-4bc4-9ea6-1ee320cbd940 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:49.772767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b8e67bc8-d6fb-4bc4-9ea6-1ee320cbd940 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:49.773247 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b8e67bc8-d6fb-4bc4-9ea6-1ee320cbd940 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:49.776366 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b8e67bc8-d6fb-4bc4-9ea6-1ee320cbd940 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:49.776366 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b8e67bc8-d6fb-4bc4-9ea6-1ee320cbd940 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:49.920885 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b8e67bc8-d6fb-4bc4-9ea6-1ee320cbd940 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:49.929127 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b8e67bc8-d6fb-4bc4-9ea6-1ee320cbd940 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1319 microversion: 2.1 time: 0.170490 Jul 19 21:03:49.929798 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 512/991] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:49 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:50.947100 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2f67eab3-db3e-4da2-a9cc-b65c0205f24e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:50.947806 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2f67eab3-db3e-4da2-a9cc-b65c0205f24e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:50.954955 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2f67eab3-db3e-4da2-a9cc-b65c0205f24e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:50.955410 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2f67eab3-db3e-4da2-a9cc-b65c0205f24e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:50.956206 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2f67eab3-db3e-4da2-a9cc-b65c0205f24e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:50.956652 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2f67eab3-db3e-4da2-a9cc-b65c0205f24e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:51.095570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2f67eab3-db3e-4da2-a9cc-b65c0205f24e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:51.103100 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2f67eab3-db3e-4da2-a9cc-b65c0205f24e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1319 microversion: 2.1 time: 0.160641 Jul 19 21:03:51.103765 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 480/992] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:50 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:52.120302 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c1197f82-a1b4-412b-95c2-dea17d718faa tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:52.120849 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c1197f82-a1b4-412b-95c2-dea17d718faa tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:52.122706 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:52.128765 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c1197f82-a1b4-412b-95c2-dea17d718faa tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:52.129212 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c1197f82-a1b4-412b-95c2-dea17d718faa tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:52.129996 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c1197f82-a1b4-412b-95c2-dea17d718faa tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:52.130430 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c1197f82-a1b4-412b-95c2-dea17d718faa tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:52.263293 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c1197f82-a1b4-412b-95c2-dea17d718faa tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:52.270865 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c1197f82-a1b4-412b-95c2-dea17d718faa tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1508 microversion: 2.1 time: 0.154629 Jul 19 21:03:52.271542 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 513/993] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:52 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:52.287536 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-682a3393-45cb-498a-aa34-80382c9912f0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5707497b-7da6-448d-8c57-6f5011ee7307", "device": "/dev/sdb"}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:52.288667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-682a3393-45cb-498a-aa34-80382c9912f0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:52.290664 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:52.291473 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=6 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:52.298138 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-682a3393-45cb-498a-aa34-80382c9912f0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:52.298684 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-682a3393-45cb-498a-aa34-80382c9912f0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:52.299494 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-682a3393-45cb-498a-aa34-80382c9912f0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:52.299943 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-682a3393-45cb-498a-aa34-80382c9912f0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:52.537283 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-682a3393-45cb-498a-aa34-80382c9912f0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "POST /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253675 Jul 19 21:03:52.537960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 481/994] 10.222.0.70 () {60 vars in 1322 bytes} [Tue Jul 19 21:03:52 2022] POST /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:04:14.126255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-fa77d035-6de0-4659-a53e-b7f6a7c96c45 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:14.127500 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-fa77d035-6de0-4659-a53e-b7f6a7c96c45 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:14.129679 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=14 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:14.130432 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=30 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:14.136381 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fa77d035-6de0-4659-a53e-b7f6a7c96c45 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:14.136863 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fa77d035-6de0-4659-a53e-b7f6a7c96c45 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:14.137665 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fa77d035-6de0-4659-a53e-b7f6a7c96c45 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:14.138102 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fa77d035-6de0-4659-a53e-b7f6a7c96c45 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:14.329499 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-fa77d035-6de0-4659-a53e-b7f6a7c96c45 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lazy-loading 'services' on Instance uuid 3a925f2b-e23a-4e0d-8206-8470473c5a30 {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:04:14.403336 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-fa77d035-6de0-4659-a53e-b7f6a7c96c45 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30/os-volume_attachments/5707497b-7da6-448d-8c57-6f5011ee7307" status: 202 len: 0 microversion: 2.1 time: 0.281337 Jul 19 21:04:14.403926 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 514/995] 10.222.0.70 () {58 vars in 1415 bytes} [Tue Jul 19 21:04:14 2022] DELETE /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30/os-volume_attachments/5707497b-7da6-448d-8c57-6f5011ee7307 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:04:15.517061 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:15.518603 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:15.522696 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-bd1ef021-b93e-431e-8635-363ff115e43b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:15.523271 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-bd1ef021-b93e-431e-8635-363ff115e43b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:15.530825 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bd1ef021-b93e-431e-8635-363ff115e43b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:15.531295 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bd1ef021-b93e-431e-8635-363ff115e43b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:15.532043 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bd1ef021-b93e-431e-8635-363ff115e43b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:15.532472 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-bd1ef021-b93e-431e-8635-363ff115e43b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:15.561459 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-bd1ef021-b93e-431e-8635-363ff115e43b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:04:15.651816 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-bd1ef021-b93e-431e-8635-363ff115e43b tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 204 len: 0 microversion: 2.1 time: 0.135912 Jul 19 21:04:15.652520 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 482/996] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 21:04:15 2022] DELETE /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:04:15.661951 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-eab0228b-d662-4c4e-b33f-61c9aa30ae7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:15.662769 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-eab0228b-d662-4c4e-b33f-61c9aa30ae7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:15.669250 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-eab0228b-d662-4c4e-b33f-61c9aa30ae7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:15.669735 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-eab0228b-d662-4c4e-b33f-61c9aa30ae7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:15.670501 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-eab0228b-d662-4c4e-b33f-61c9aa30ae7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:15.670941 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-eab0228b-d662-4c4e-b33f-61c9aa30ae7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:15.808600 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-eab0228b-d662-4c4e-b33f-61c9aa30ae7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:15.817564 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-eab0228b-d662-4c4e-b33f-61c9aa30ae7e tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1514 microversion: 2.1 time: 0.160280 Jul 19 21:04:15.818172 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 515/997] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:15 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:04:16.836143 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5c3503b3-5600-4f1c-b4ba-ddbc0cc89ea1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:16.836842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5c3503b3-5600-4f1c-b4ba-ddbc0cc89ea1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:16.843480 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5c3503b3-5600-4f1c-b4ba-ddbc0cc89ea1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:16.843928 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5c3503b3-5600-4f1c-b4ba-ddbc0cc89ea1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:16.845070 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5c3503b3-5600-4f1c-b4ba-ddbc0cc89ea1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:16.845430 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5c3503b3-5600-4f1c-b4ba-ddbc0cc89ea1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:17.032150 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5c3503b3-5600-4f1c-b4ba-ddbc0cc89ea1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:17.040582 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5c3503b3-5600-4f1c-b4ba-ddbc0cc89ea1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1514 microversion: 2.1 time: 0.208681 Jul 19 21:04:17.041162 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 483/998] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:16 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:18.054698 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-3aa083c6-cc0d-46cd-ae45-c5b4f56956cd req-3ad42f1a-d50f-4138-a0fb-31449cefea01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a925f2b-e23a-4e0d-8206-8470473c5a30", "name": "network-vif-deleted", "tag": "0b3c758d-9c4b-4773-9f7f-05291d2d0a80"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:18.061785 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a25349d1-54e7-47f9-b6df-8c49cded3bd0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:18.063437 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-3aa083c6-cc0d-46cd-ae45-c5b4f56956cd req-3ad42f1a-d50f-4138-a0fb-31449cefea01 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:18.063880 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-3aa083c6-cc0d-46cd-ae45-c5b4f56956cd req-3ad42f1a-d50f-4138-a0fb-31449cefea01 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:18.066251 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a25349d1-54e7-47f9-b6df-8c49cded3bd0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:18.077107 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-3aa083c6-cc0d-46cd-ae45-c5b4f56956cd req-3ad42f1a-d50f-4138-a0fb-31449cefea01 service nova] Creating event network-vif-deleted:0b3c758d-9c4b-4773-9f7f-05291d2d0a80 for instance 3a925f2b-e23a-4e0d-8206-8470473c5a30 on hv-cinder-79987 Jul 19 21:04:18.078018 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a25349d1-54e7-47f9-b6df-8c49cded3bd0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:18.078749 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a25349d1-54e7-47f9-b6df-8c49cded3bd0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:18.079747 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a25349d1-54e7-47f9-b6df-8c49cded3bd0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:18.081659 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a25349d1-54e7-47f9-b6df-8c49cded3bd0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:18.083643 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-3aa083c6-cc0d-46cd-ae45-c5b4f56956cd req-3ad42f1a-d50f-4138-a0fb-31449cefea01 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032474 Jul 19 21:04:18.084244 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 516/999] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:04:18.168405 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a25349d1-54e7-47f9-b6df-8c49cded3bd0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02317457dae42069b86da4bd35278b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d7d00a1ff0437cb7fc46658c3a1f79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:18.176125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a25349d1-54e7-47f9-b6df-8c49cded3bd0 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 200 len: 1472 microversion: 2.1 time: 0.121150 Jul 19 21:04:18.177275 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 484/1000] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:18 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 1472 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:18.257253 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:04:18.257501 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Tue Jul 19 21:04:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:04:19.195506 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-efd1dbcb-a371-4070-9709-706f328da3d1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:19.196234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-efd1dbcb-a371-4070-9709-706f328da3d1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] [instance: 3a925f2b-e23a-4e0d-8206-8470473c5a30] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:19.203627 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-efd1dbcb-a371-4070-9709-706f328da3d1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:19.204075 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-efd1dbcb-a371-4070-9709-706f328da3d1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:19.204842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-efd1dbcb-a371-4070-9709-706f328da3d1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:19.205287 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-efd1dbcb-a371-4070-9709-706f328da3d1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:19.219372 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-efd1dbcb-a371-4070-9709-706f328da3d1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] HTTP exception thrown: Instance 3a925f2b-e23a-4e0d-8206-8470473c5a30 could not be found. Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-efd1dbcb-a371-4070-9709-706f328da3d1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Request method failure captured: Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 HTTP/1.1 Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xvg2j-j0pPgOIOAOT4WXXen_pNrlITxT2MHv_xJAT6NawNOEAsog1DHGVnh3BNmH-uQbyx6gPGb-dzM69lmRnfV55ZHbiai3XUb6axWqs5_G35Jxh5OHWk9d8oY7z3tvHcBe0LCPOgMET8cbalszBwSDK_XmQaK_C8NM2s9TjLAaBo Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 44d7d00a1ff0437cb7fc46658c3a1f79 Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1824137296 Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 21:04:19.221045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 21:04:19.222936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/44d7d00a1ff0437cb7fc46658c3a1f79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/44d7d00a1ff0437cb7fc46658c3a1f79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/44d7d00a1ff0437cb7fc46658c3a1f79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_44d7d00a1ff0437cb7fc46658c3a1f79", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 21:04:19.222936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-VolumesSnapshotTestJSON-1824137296 Jul 19 21:04:19.222936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 44d7d00a1ff0437cb7fc46658c3a1f79 Jul 19 21:04:19.222936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1824137296 Jul 19 21:04:19.222936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-VolumesSnapshotTestJSON-1824137296-project Jul 19 21:04:19.222936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 21:04:19.222936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 21:04:19.222936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: a02317457dae42069b86da4bd35278b4 Jul 19 21:04:19.222936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-VolumesSnapshotTestJSON-1824137296-project Jul 19 21:04:19.222936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 21:04:19.222936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance 3a925f2b-e23a-4e0d-8206-8470473c5a30 could not be found. Jul 19 21:04:19.222936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': '3a925f2b-e23a-4e0d-8206-8470473c5a30'} Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a925f2b-e23a-4e0d-8206-8470473c5a30 could not be found. Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:04:19.224052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a925f2b-e23a-4e0d-8206-8470473c5a30 could not be found. Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a925f2b-e23a-4e0d-8206-8470473c5a30 could not be found. Jul 19 21:04:19.225744 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:04:19.227205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-efd1dbcb-a371-4070-9709-706f328da3d1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] Returning 404 to user: Instance 3a925f2b-e23a-4e0d-8206-8470473c5a30 could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:04:19.227205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-efd1dbcb-a371-4070-9709-706f328da3d1 tempest-VolumesSnapshotTestJSON-1824137296 tempest-VolumesSnapshotTestJSON-1824137296-project] 10.222.0.70 "GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30" status: 404 len: 111 microversion: 2.1 time: 0.032225 Jul 19 21:04:19.227205 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 517/1001] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:19 2022] GET /compute/v2.1/servers/3a925f2b-e23a-4e0d-8206-8470473c5a30 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:04:20.015679 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:04:20.015977 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Tue Jul 19 21:04:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:04:34.188351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:04:34.189192 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Tue Jul 19 21:04:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:04:45.154330 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d533d385-6876-4c7f-810f-d10a6aafcc38 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:45.154330 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d533d385-6876-4c7f-810f-d10a6aafcc38 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:45.155919 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:45.156578 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:45.162738 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d533d385-6876-4c7f-810f-d10a6aafcc38 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:45.163199 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d533d385-6876-4c7f-810f-d10a6aafcc38 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:45.163981 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d533d385-6876-4c7f-810f-d10a6aafcc38 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:45.164420 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d533d385-6876-4c7f-810f-d10a6aafcc38 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:45.193286 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d533d385-6876-4c7f-810f-d10a6aafcc38 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Going to try to terminate instance {{(pid=129867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:04:45.286403 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d533d385-6876-4c7f-810f-d10a6aafcc38 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 204 len: 0 microversion: 2.1 time: 0.136737 Jul 19 21:04:45.287349 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 485/1002] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 21:04:45 2022] DELETE /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:04:45.295695 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dd7917e4-9cde-4b19-8fa9-a93aaaae6d72 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:45.296459 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-dd7917e4-9cde-4b19-8fa9-a93aaaae6d72 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:45.300704 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=8 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:45.301273 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:45.306384 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dd7917e4-9cde-4b19-8fa9-a93aaaae6d72 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:45.306852 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dd7917e4-9cde-4b19-8fa9-a93aaaae6d72 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:45.307621 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dd7917e4-9cde-4b19-8fa9-a93aaaae6d72 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:45.308155 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dd7917e4-9cde-4b19-8fa9-a93aaaae6d72 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:45.469602 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dd7917e4-9cde-4b19-8fa9-a93aaaae6d72 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:45.477409 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dd7917e4-9cde-4b19-8fa9-a93aaaae6d72 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1575 microversion: 2.1 time: 0.185839 Jul 19 21:04:45.477981 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 518/1003] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:45 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:46.498533 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f1b8a7ab-a694-46ad-a733-f1c682d181ed tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:46.499226 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f1b8a7ab-a694-46ad-a733-f1c682d181ed tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:46.506579 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1b8a7ab-a694-46ad-a733-f1c682d181ed tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:46.507071 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1b8a7ab-a694-46ad-a733-f1c682d181ed tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:46.507877 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1b8a7ab-a694-46ad-a733-f1c682d181ed tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:46.508378 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1b8a7ab-a694-46ad-a733-f1c682d181ed tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:46.664777 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f1b8a7ab-a694-46ad-a733-f1c682d181ed tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:46.672969 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f1b8a7ab-a694-46ad-a733-f1c682d181ed tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1575 microversion: 2.1 time: 0.178703 Jul 19 21:04:46.673601 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 486/1004] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:46 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:47.691292 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0ef380f0-4c72-4bbb-824b-2f175a267f8c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:47.692250 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0ef380f0-4c72-4bbb-824b-2f175a267f8c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:47.698721 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0ef380f0-4c72-4bbb-824b-2f175a267f8c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:47.699217 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0ef380f0-4c72-4bbb-824b-2f175a267f8c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:47.700013 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0ef380f0-4c72-4bbb-824b-2f175a267f8c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:47.700512 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0ef380f0-4c72-4bbb-824b-2f175a267f8c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:47.797104 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0ef380f0-4c72-4bbb-824b-2f175a267f8c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:47.805412 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0ef380f0-4c72-4bbb-824b-2f175a267f8c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1507 microversion: 2.1 time: 0.118671 Jul 19 21:04:47.805908 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 519/1005] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:47 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1507 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:48.327578 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-085c6041-ede7-4a3e-b83e-cd69a2d25ba1 req-65b0823a-ec21-4cd2-83d0-7326562c6e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff", "name": "network-vif-deleted", "tag": "7cb37530-c58e-43a7-af6e-c01992fdd5fd"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:48.338226 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-085c6041-ede7-4a3e-b83e-cd69a2d25ba1 req-65b0823a-ec21-4cd2-83d0-7326562c6e2f service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:48.338672 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-085c6041-ede7-4a3e-b83e-cd69a2d25ba1 req-65b0823a-ec21-4cd2-83d0-7326562c6e2f service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:48.351589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-085c6041-ede7-4a3e-b83e-cd69a2d25ba1 req-65b0823a-ec21-4cd2-83d0-7326562c6e2f service nova] Creating event network-vif-deleted:7cb37530-c58e-43a7-af6e-c01992fdd5fd for instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff on hv-cinder-79987 Jul 19 21:04:48.358130 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-085c6041-ede7-4a3e-b83e-cd69a2d25ba1 req-65b0823a-ec21-4cd2-83d0-7326562c6e2f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034531 Jul 19 21:04:48.358675 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 487/1006] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:04:48.823478 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-29e68e7f-c596-4947-b87c-4b8c955355d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:48.824077 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-29e68e7f-c596-4947-b87c-4b8c955355d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:48.831092 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-29e68e7f-c596-4947-b87c-4b8c955355d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:48.831525 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-29e68e7f-c596-4947-b87c-4b8c955355d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:48.832570 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-29e68e7f-c596-4947-b87c-4b8c955355d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:48.832872 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-29e68e7f-c596-4947-b87c-4b8c955355d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:48.900036 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-29e68e7f-c596-4947-b87c-4b8c955355d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:48.907633 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-29e68e7f-c596-4947-b87c-4b8c955355d1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1507 microversion: 2.1 time: 0.088057 Jul 19 21:04:48.908190 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 520/1007] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:48 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1507 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:49.932060 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-75c37321-7036-47f9-a03f-1844b3c58141 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:49.933620 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-75c37321-7036-47f9-a03f-1844b3c58141 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:49.941020 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-75c37321-7036-47f9-a03f-1844b3c58141 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:49.941556 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-75c37321-7036-47f9-a03f-1844b3c58141 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:49.942996 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-75c37321-7036-47f9-a03f-1844b3c58141 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:49.943522 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-75c37321-7036-47f9-a03f-1844b3c58141 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:50.012455 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-75c37321-7036-47f9-a03f-1844b3c58141 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:50.022107 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-75c37321-7036-47f9-a03f-1844b3c58141 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1224 microversion: 2.1 time: 0.099776 Jul 19 21:04:50.022693 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 488/1008] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:49 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:04:51.040393 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-bdd93444-14c9-4636-bc5b-549aeb5e0a7b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:51.041477 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-bdd93444-14c9-4636-bc5b-549aeb5e0a7b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:51.048338 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bdd93444-14c9-4636-bc5b-549aeb5e0a7b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:51.048781 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bdd93444-14c9-4636-bc5b-549aeb5e0a7b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:51.049574 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bdd93444-14c9-4636-bc5b-549aeb5e0a7b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:51.050038 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bdd93444-14c9-4636-bc5b-549aeb5e0a7b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:51.113508 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-bdd93444-14c9-4636-bc5b-549aeb5e0a7b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:51.128124 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-bdd93444-14c9-4636-bc5b-549aeb5e0a7b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 200 len: 1224 microversion: 2.1 time: 0.090475 Jul 19 21:04:51.129334 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 521/1009] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:51 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:04:52.147486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7e9aa23d-9350-4fb5-acc6-bbf635ce1262 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:52.148212 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7e9aa23d-9350-4fb5-acc6-bbf635ce1262 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:52.159276 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7e9aa23d-9350-4fb5-acc6-bbf635ce1262 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:52.159732 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7e9aa23d-9350-4fb5-acc6-bbf635ce1262 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:52.160519 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7e9aa23d-9350-4fb5-acc6-bbf635ce1262 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:52.160954 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7e9aa23d-9350-4fb5-acc6-bbf635ce1262 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:52.175066 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-7e9aa23d-9350-4fb5-acc6-bbf635ce1262 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] HTTP exception thrown: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7e9aa23d-9350-4fb5-acc6-bbf635ce1262 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Request method failure captured: Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff HTTP/1.1 Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xuXKbIBFWqtz7fCbV5mHqDmGGePmBN0XUQUazmE64oh_bYT4Ze51l78hFAhiYvgahDxRICRhzQcXoNKJKjVBbEZXmBRpgRDJKYmvLD4fXY99_2hWue_KvWPa6kbXHDZFhwhOjUsbXJr8IBQprlaYW5ukh9vVixgIuYaTMqjaQhaDPs Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 60fdf04148f548f1b9fe86ed038e839f Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-TestVolumeBootPattern-904408898 Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 21:04:52.176827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 21:04:52.180155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_60fdf04148f548f1b9fe86ed038e839f", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 21:04:52.180155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-TestVolumeBootPattern-904408898 Jul 19 21:04:52.180155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 60fdf04148f548f1b9fe86ed038e839f Jul 19 21:04:52.180155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-TestVolumeBootPattern-904408898 Jul 19 21:04:52.180155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-TestVolumeBootPattern-904408898-project Jul 19 21:04:52.180155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 21:04:52.180155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 21:04:52.180155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: cf1d05ee73d4414eb51e2a7be838e28f Jul 19 21:04:52.180155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-TestVolumeBootPattern-904408898-project Jul 19 21:04:52.180155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 21:04:52.180155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:04:52.180155 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': 'fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff'} Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:04:52.181114 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:04:52.182726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:04:52.184100 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7e9aa23d-9350-4fb5-acc6-bbf635ce1262 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Returning 404 to user: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:04:52.184100 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7e9aa23d-9350-4fb5-acc6-bbf635ce1262 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 404 len: 111 microversion: 2.1 time: 0.034998 Jul 19 21:04:52.184100 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 489/1010] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:52 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:04:52.312460 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1746840470", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-286713671", "security_groups": [{"name": "tempest-secgroup-smoke-1787866983"}], "block_device_mapping_v2": [{"uuid": "af0bd2ff-bf47-471b-8e90-0ffc46d4df03", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "231fd8b6-2aae-45bf-aa90-12b047385fb7"}]}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:52.447998 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.network.neutron [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] validate_networks() for [('231fd8b6-2aae-45bf-aa90-12b047385fb7', None, None, None, None, None)] {{(pid=129866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:04:52.839353 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Flavor limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:04:52.839773 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Image limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:04:52.840248 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Flavor pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:04:52.840662 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Image pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:04:52.841067 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:04:52.851311 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:52.851755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:52.852667 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:52.853084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:52.870451 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Getting quotas for project 60fdf04148f548f1b9fe86ed038e839f. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:04:52.874384 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Getting quotas for user cf1d05ee73d4414eb51e2a7be838e28f and project 60fdf04148f548f1b9fe86ed038e839f. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:04:52.933764 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Going to run 1 instances... {{(pid=129866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:04:52.935909 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af0bd2ff-bf47-471b-8e90-0ffc46d4df03',volume_size=None,volume_type=None)] {{(pid=129866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:04:53.075118 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d679511f-f489-42cb-89ac-b021d42a4406 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.768939 Jul 19 21:04:53.075926 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 522/1011] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 21:04:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:04:53.086550 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-52a36c56-b072-4af3-b584-d0cf11c541ce tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:53.087266 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-52a36c56-b072-4af3-b584-d0cf11c541ce tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:53.145140 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-52a36c56-b072-4af3-b584-d0cf11c541ce tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:53.152338 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-52a36c56-b072-4af3-b584-d0cf11c541ce tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1094 microversion: 2.1 time: 0.069806 Jul 19 21:04:53.154960 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 490/1012] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:53 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:54.173966 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ad1a69bd-2171-4920-a8dc-fcf4e244a28c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:54.175319 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ad1a69bd-2171-4920-a8dc-fcf4e244a28c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:54.185471 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ad1a69bd-2171-4920-a8dc-fcf4e244a28c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:54.186085 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ad1a69bd-2171-4920-a8dc-fcf4e244a28c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:54.186959 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ad1a69bd-2171-4920-a8dc-fcf4e244a28c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:54.187497 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ad1a69bd-2171-4920-a8dc-fcf4e244a28c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:54.263124 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-ad1a69bd-2171-4920-a8dc-fcf4e244a28c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:54.271466 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ad1a69bd-2171-4920-a8dc-fcf4e244a28c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1210 microversion: 2.1 time: 0.103732 Jul 19 21:04:54.272041 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 523/1013] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:54 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:55.305543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-28468753-3288-4e95-91c5-b42bd617f582 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:55.306875 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-28468753-3288-4e95-91c5-b42bd617f582 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:55.316350 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-28468753-3288-4e95-91c5-b42bd617f582 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:55.317641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-28468753-3288-4e95-91c5-b42bd617f582 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:55.319321 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-28468753-3288-4e95-91c5-b42bd617f582 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:55.319963 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-28468753-3288-4e95-91c5-b42bd617f582 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:55.560940 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-28468753-3288-4e95-91c5-b42bd617f582 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:55.572676 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-28468753-3288-4e95-91c5-b42bd617f582 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.272509 Jul 19 21:04:55.573832 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 491/1014] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:55 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:55.627835 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-905df645-6fc8-46a9-b4b5-6f4ac62042f5 req-88dac513-d67c-42ec-b9b5-8734a556ae76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d", "tag": "7bddc221-6831-47f2-8121-1697a92ecc3b"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:55.676012 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-905df645-6fc8-46a9-b4b5-6f4ac62042f5 req-88dac513-d67c-42ec-b9b5-8734a556ae76 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:55.680134 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-905df645-6fc8-46a9-b4b5-6f4ac62042f5 req-88dac513-d67c-42ec-b9b5-8734a556ae76 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:55.693981 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-905df645-6fc8-46a9-b4b5-6f4ac62042f5 req-88dac513-d67c-42ec-b9b5-8734a556ae76 service nova] Creating event network-changed:7bddc221-6831-47f2-8121-1697a92ecc3b for instance e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d on hv-cinder-79987 Jul 19 21:04:55.699278 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-905df645-6fc8-46a9-b4b5-6f4ac62042f5 req-88dac513-d67c-42ec-b9b5-8734a556ae76 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077893 Jul 19 21:04:55.700257 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 524/1015] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:04:56.590775 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-58aba8ee-a11b-4b17-9fd5-eabcff023257 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:56.591388 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-58aba8ee-a11b-4b17-9fd5-eabcff023257 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:56.598306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-58aba8ee-a11b-4b17-9fd5-eabcff023257 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:56.599250 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-58aba8ee-a11b-4b17-9fd5-eabcff023257 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:56.600034 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-58aba8ee-a11b-4b17-9fd5-eabcff023257 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:56.600472 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-58aba8ee-a11b-4b17-9fd5-eabcff023257 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:56.808338 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-58aba8ee-a11b-4b17-9fd5-eabcff023257 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:56.816518 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-58aba8ee-a11b-4b17-9fd5-eabcff023257 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.229549 Jul 19 21:04:56.817097 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 492/1016] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:56 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:57.834038 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-1ec12da7-e436-4568-a2a5-2a1707d74cd7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:57.835594 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-1ec12da7-e436-4568-a2a5-2a1707d74cd7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:57.842818 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1ec12da7-e436-4568-a2a5-2a1707d74cd7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:57.843622 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1ec12da7-e436-4568-a2a5-2a1707d74cd7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:57.845525 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1ec12da7-e436-4568-a2a5-2a1707d74cd7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:57.846436 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1ec12da7-e436-4568-a2a5-2a1707d74cd7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:58.119577 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-1ec12da7-e436-4568-a2a5-2a1707d74cd7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:58.129018 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-1ec12da7-e436-4568-a2a5-2a1707d74cd7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.299242 Jul 19 21:04:58.130175 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 525/1017] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:57 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:59.147403 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4726924b-160e-4d2c-b210-ac9a8ed623e3 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:59.148193 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4726924b-160e-4d2c-b210-ac9a8ed623e3 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:59.155169 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4726924b-160e-4d2c-b210-ac9a8ed623e3 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:59.155648 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4726924b-160e-4d2c-b210-ac9a8ed623e3 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:59.156430 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4726924b-160e-4d2c-b210-ac9a8ed623e3 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:59.156882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4726924b-160e-4d2c-b210-ac9a8ed623e3 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:59.418397 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4726924b-160e-4d2c-b210-ac9a8ed623e3 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:59.429437 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4726924b-160e-4d2c-b210-ac9a8ed623e3 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.286666 Jul 19 21:04:59.430103 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 493/1018] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:59 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:00.447823 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-93f7f925-4939-4b40-ab6c-517f1fcf8539 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:00.448539 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-93f7f925-4939-4b40-ab6c-517f1fcf8539 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:00.455510 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-93f7f925-4939-4b40-ab6c-517f1fcf8539 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:00.456015 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-93f7f925-4939-4b40-ab6c-517f1fcf8539 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:00.456796 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-93f7f925-4939-4b40-ab6c-517f1fcf8539 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:00.457231 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-93f7f925-4939-4b40-ab6c-517f1fcf8539 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:00.742273 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-93f7f925-4939-4b40-ab6c-517f1fcf8539 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:00.753048 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-93f7f925-4939-4b40-ab6c-517f1fcf8539 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.309656 Jul 19 21:05:00.754485 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 526/1019] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:00 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:01.773233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b2a5266c-b174-4251-8721-dedb797c2045 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:01.773747 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b2a5266c-b174-4251-8721-dedb797c2045 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:01.781181 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b2a5266c-b174-4251-8721-dedb797c2045 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:01.781667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b2a5266c-b174-4251-8721-dedb797c2045 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:01.782462 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b2a5266c-b174-4251-8721-dedb797c2045 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:01.782908 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b2a5266c-b174-4251-8721-dedb797c2045 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:01.962840 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b2a5266c-b174-4251-8721-dedb797c2045 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:01.971722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b2a5266c-b174-4251-8721-dedb797c2045 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.204332 Jul 19 21:05:01.972599 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 494/1020] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:01 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:02.988327 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d3425061-c102-4e4e-9600-77565e6d1d53 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:02.989060 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d3425061-c102-4e4e-9600-77565e6d1d53 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:02.995889 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:03.001957 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=6 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:03.008085 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d3425061-c102-4e4e-9600-77565e6d1d53 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:03.008809 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d3425061-c102-4e4e-9600-77565e6d1d53 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:03.009829 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d3425061-c102-4e4e-9600-77565e6d1d53 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:03.010271 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d3425061-c102-4e4e-9600-77565e6d1d53 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:03.194909 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d3425061-c102-4e4e-9600-77565e6d1d53 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:03.203507 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d3425061-c102-4e4e-9600-77565e6d1d53 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.219110 Jul 19 21:05:03.204370 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 527/1021] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:02 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:04.221986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-85cefc77-f516-43f2-939c-3e4ff8c70246 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:04.223394 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-85cefc77-f516-43f2-939c-3e4ff8c70246 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:04.226248 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:04.231954 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-85cefc77-f516-43f2-939c-3e4ff8c70246 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:04.232744 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-85cefc77-f516-43f2-939c-3e4ff8c70246 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:04.233789 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-85cefc77-f516-43f2-939c-3e4ff8c70246 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:04.234454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-85cefc77-f516-43f2-939c-3e4ff8c70246 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:04.417934 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-85cefc77-f516-43f2-939c-3e4ff8c70246 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:04.427289 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-85cefc77-f516-43f2-939c-3e4ff8c70246 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.209369 Jul 19 21:05:04.428159 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 495/1022] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:04 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:05:05.454218 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-918ec2a0-dfb7-4d8e-9ed7-af678e13d4de tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:05.455005 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-918ec2a0-dfb7-4d8e-9ed7-af678e13d4de tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:05.461674 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-918ec2a0-dfb7-4d8e-9ed7-af678e13d4de tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:05.462455 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-918ec2a0-dfb7-4d8e-9ed7-af678e13d4de tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:05.463401 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-918ec2a0-dfb7-4d8e-9ed7-af678e13d4de tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:05.463919 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-918ec2a0-dfb7-4d8e-9ed7-af678e13d4de tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:05.718839 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-918ec2a0-dfb7-4d8e-9ed7-af678e13d4de tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:05.743430 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-918ec2a0-dfb7-4d8e-9ed7-af678e13d4de tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.292573 Jul 19 21:05:05.744652 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 528/1023] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:05 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:06.762491 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9160aaf1-ee01-4674-9b70-f620041a6403 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:06.764486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9160aaf1-ee01-4674-9b70-f620041a6403 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:06.773867 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9160aaf1-ee01-4674-9b70-f620041a6403 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:06.774453 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9160aaf1-ee01-4674-9b70-f620041a6403 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:06.775641 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9160aaf1-ee01-4674-9b70-f620041a6403 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:06.776310 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9160aaf1-ee01-4674-9b70-f620041a6403 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:07.130905 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9160aaf1-ee01-4674-9b70-f620041a6403 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:07.140986 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9160aaf1-ee01-4674-9b70-f620041a6403 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.383259 Jul 19 21:05:07.141900 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 496/1024] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:06 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:07.804684 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-62c1a6c3-67bf-4631-bc21-59bca7bfdcf3 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Action: 'create', calling method: .version_select at 0x7f25277f3790>, body: {"keypair": {"name": "tempest-TestShelveInstance-459913253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBhCP5Pyfoqoz+HwT/sRwthH0PDHtTskXqP5Qzvhr5aBOHsxrxhyKEJEpzV05HO93h3Scb7HfXTh+07IF89D8n7vXaghybAjB+ydEBMRysf1y/hFtsAcLqfIDdtJZsxMw=="}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:07.822581 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-62c1a6c3-67bf-4631-bc21-59bca7bfdcf3 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Getting quotas for project 5137218fb08e4f969b878d5cafd71eb9. Resources: {'key_pairs'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:05:07.826752 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-62c1a6c3-67bf-4631-bc21-59bca7bfdcf3 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Getting quotas for user ecfef5962b4242cda52c537e9440e3f9 and project 5137218fb08e4f969b878d5cafd71eb9. Resources: {'key_pairs'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:05:07.867062 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-62c1a6c3-67bf-4631-bc21-59bca7bfdcf3 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.250531 Jul 19 21:05:07.867828 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 529/1025] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jul 19 21:05:07 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:08.159277 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4868c5b7-1a42-4970-9815-0c6d09d27db2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:08.161682 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4868c5b7-1a42-4970-9815-0c6d09d27db2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:08.172803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4868c5b7-1a42-4970-9815-0c6d09d27db2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:08.173628 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4868c5b7-1a42-4970-9815-0c6d09d27db2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:08.174708 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4868c5b7-1a42-4970-9815-0c6d09d27db2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:08.175268 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4868c5b7-1a42-4970-9815-0c6d09d27db2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:08.337229 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4868c5b7-1a42-4970-9815-0c6d09d27db2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:08.352935 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4868c5b7-1a42-4970-9815-0c6d09d27db2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.196967 Jul 19 21:05:08.354470 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 497/1026] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:08 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:09.201647 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-deb9ece6-2c5a-4cd9-af34-7f8e50cf6161 req-51a82601-a593-47f3-85a4-83ff3b659335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d", "name": "network-vif-plugged", "status": "completed", "tag": "7bddc221-6831-47f2-8121-1697a92ecc3b"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:09.214441 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-deb9ece6-2c5a-4cd9-af34-7f8e50cf6161 req-51a82601-a593-47f3-85a4-83ff3b659335 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:09.214876 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-deb9ece6-2c5a-4cd9-af34-7f8e50cf6161 req-51a82601-a593-47f3-85a4-83ff3b659335 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:09.237396 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-deb9ece6-2c5a-4cd9-af34-7f8e50cf6161 req-51a82601-a593-47f3-85a4-83ff3b659335 service nova] Creating event network-vif-plugged:7bddc221-6831-47f2-8121-1697a92ecc3b for instance e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d on hv-cinder-79987 Jul 19 21:05:09.245683 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-deb9ece6-2c5a-4cd9-af34-7f8e50cf6161 req-51a82601-a593-47f3-85a4-83ff3b659335 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046909 Jul 19 21:05:09.246706 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 530/1027] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:09.386964 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-95d015b3-fadf-48cb-8d56-b171124780ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:09.388779 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-95d015b3-fadf-48cb-8d56-b171124780ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:09.398455 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-95d015b3-fadf-48cb-8d56-b171124780ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:09.399510 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-95d015b3-fadf-48cb-8d56-b171124780ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:09.400953 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-95d015b3-fadf-48cb-8d56-b171124780ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:09.401774 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-95d015b3-fadf-48cb-8d56-b171124780ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:09.632549 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-95d015b3-fadf-48cb-8d56-b171124780ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:09.646750 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-95d015b3-fadf-48cb-8d56-b171124780ca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.278246 Jul 19 21:05:09.649889 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 498/1028] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:09 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:10.666185 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-12841575-0c1d-4540-9e53-a7df763c5fca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:10.666907 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-12841575-0c1d-4540-9e53-a7df763c5fca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:10.673252 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12841575-0c1d-4540-9e53-a7df763c5fca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:10.673956 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12841575-0c1d-4540-9e53-a7df763c5fca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:10.674723 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12841575-0c1d-4540-9e53-a7df763c5fca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:10.675153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-12841575-0c1d-4540-9e53-a7df763c5fca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:10.813889 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-12841575-0c1d-4540-9e53-a7df763c5fca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:10.821351 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-12841575-0c1d-4540-9e53-a7df763c5fca tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1266 microversion: 2.1 time: 0.160833 Jul 19 21:05:10.821928 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 531/1029] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:10 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:11.838626 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5bfdd284-6489-4d6b-ae45-e4e088b17e5c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:11.839241 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5bfdd284-6489-4d6b-ae45-e4e088b17e5c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:11.846470 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5bfdd284-6489-4d6b-ae45-e4e088b17e5c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:11.847008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5bfdd284-6489-4d6b-ae45-e4e088b17e5c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:11.847802 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5bfdd284-6489-4d6b-ae45-e4e088b17e5c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:11.848249 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5bfdd284-6489-4d6b-ae45-e4e088b17e5c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:12.040016 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5bfdd284-6489-4d6b-ae45-e4e088b17e5c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:12.048943 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5bfdd284-6489-4d6b-ae45-e4e088b17e5c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1453 microversion: 2.1 time: 0.214090 Jul 19 21:05:12.049982 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 499/1030] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:11 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1453 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:12.073689 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-531a9b9d-9efa-4890-b2b5-1d291a9b721d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:12.074746 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-531a9b9d-9efa-4890-b2b5-1d291a9b721d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:12.090206 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-531a9b9d-9efa-4890-b2b5-1d291a9b721d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:12.090949 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-531a9b9d-9efa-4890-b2b5-1d291a9b721d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:12.092555 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-531a9b9d-9efa-4890-b2b5-1d291a9b721d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:12.093258 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-531a9b9d-9efa-4890-b2b5-1d291a9b721d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:12.262083 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-531a9b9d-9efa-4890-b2b5-1d291a9b721d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:12.272067 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-531a9b9d-9efa-4890-b2b5-1d291a9b721d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1453 microversion: 2.1 time: 0.201619 Jul 19 21:05:12.273229 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 532/1031] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:12 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1453 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:05:14.070411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-298d581e-23ea-4431-ba20-6cde8dca4fab req-22b55e86-3bf2-475f-9188-692410f04ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d", "tag": "7bddc221-6831-47f2-8121-1697a92ecc3b"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:14.084445 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-298d581e-23ea-4431-ba20-6cde8dca4fab req-22b55e86-3bf2-475f-9188-692410f04ce2 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:14.085012 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-298d581e-23ea-4431-ba20-6cde8dca4fab req-22b55e86-3bf2-475f-9188-692410f04ce2 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:14.097250 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-298d581e-23ea-4431-ba20-6cde8dca4fab req-22b55e86-3bf2-475f-9188-692410f04ce2 service nova] Creating event network-changed:7bddc221-6831-47f2-8121-1697a92ecc3b for instance e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d on hv-cinder-79987 Jul 19 21:05:14.104322 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-298d581e-23ea-4431-ba20-6cde8dca4fab req-22b55e86-3bf2-475f-9188-692410f04ce2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037748 Jul 19 21:05:14.104919 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 500/1032] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:31.696046 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-969404645", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-459913253", "security_groups": [{"name": "tempest-secgroup-smoke-31322456"}], "networks": [{"uuid": "88b98cd9-e222-4c8d-999c-e1a9ae40df13"}], "block_device_mapping_v2": [{"uuid": "eb880f15-aa1c-4164-aeb8-4ecd708b13e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:31.704773 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=4 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:31.705143 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:31.705804 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=72 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:31.820952 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.network.neutron [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] validate_networks() for [('88b98cd9-e222-4c8d-999c-e1a9ae40df13', None, None, None, None, None)] {{(pid=129866) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:05:32.239776 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Flavor limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:05:32.240210 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Image limits 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:05:32.240725 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Flavor pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:05:32.241203 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Image pref 0:0:0 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:05:32.241783 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.virt.hardware [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:05:32.252113 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:32.252562 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:32.253715 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:32.253948 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:32.272419 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Getting quotas for project 5137218fb08e4f969b878d5cafd71eb9. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:05:32.277153 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.quota [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Getting quotas for user ecfef5962b4242cda52c537e9440e3f9 and project 5137218fb08e4f969b878d5cafd71eb9. Resources: {'instances', 'ram', 'cores'} {{(pid=129866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:05:32.337473 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Going to run 1 instances... {{(pid=129866) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:05:32.339532 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb880f15-aa1c-4164-aeb8-4ecd708b13e4',volume_size=None,volume_type=None)] {{(pid=129866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:05:32.470342 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d531e196-62e4-4954-9887-6ebab462f89b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.778363 Jul 19 21:05:32.470981 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 533/1033] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 21:05:31 2022] POST /compute/v2.1/servers => generated 404 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 21:05:32.479527 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:32.480369 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:32.484783 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4b9a75df-d05e-495f-b21b-c0701461c2e3 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:32.485424 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4b9a75df-d05e-495f-b21b-c0701461c2e3 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:32.555568 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4b9a75df-d05e-495f-b21b-c0701461c2e3 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:32.562974 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4b9a75df-d05e-495f-b21b-c0701461c2e3 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1087 microversion: 2.1 time: 0.085061 Jul 19 21:05:32.563546 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 501/1034] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:32 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1087 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:33.580926 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8e7fdef3-cd7e-415d-bc2d-9779fdbc2b12 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:33.582037 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8e7fdef3-cd7e-415d-bc2d-9779fdbc2b12 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:33.593534 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8e7fdef3-cd7e-415d-bc2d-9779fdbc2b12 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:33.594365 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8e7fdef3-cd7e-415d-bc2d-9779fdbc2b12 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:33.595378 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8e7fdef3-cd7e-415d-bc2d-9779fdbc2b12 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:33.595822 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8e7fdef3-cd7e-415d-bc2d-9779fdbc2b12 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:33.663762 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-8e7fdef3-cd7e-415d-bc2d-9779fdbc2b12 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:33.672542 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8e7fdef3-cd7e-415d-bc2d-9779fdbc2b12 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1203 microversion: 2.1 time: 0.096175 Jul 19 21:05:33.673388 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 534/1035] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:33 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1203 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:34.692640 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9feff559-62a6-448b-9af4-7d593985e368 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:34.693573 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9feff559-62a6-448b-9af4-7d593985e368 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:34.702733 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9feff559-62a6-448b-9af4-7d593985e368 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:34.703338 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9feff559-62a6-448b-9af4-7d593985e368 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:34.704409 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9feff559-62a6-448b-9af4-7d593985e368 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:34.704876 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9feff559-62a6-448b-9af4-7d593985e368 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:34.894128 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-9feff559-62a6-448b-9af4-7d593985e368 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:34.904921 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9feff559-62a6-448b-9af4-7d593985e368 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.217565 Jul 19 21:05:34.915312 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 502/1036] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:34 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:05:35.045204 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-b0e87c1f-7fe4-4f6a-8947-60605d6eeaae req-ddb0b18c-33b9-4abc-b871-393a3e3cfa6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aefc5a6-acfc-44c4-8693-49c65685d81a", "tag": "8d5caf68-fc5b-416c-8933-e257fcb6edd9"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:35.066026 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-b0e87c1f-7fe4-4f6a-8947-60605d6eeaae req-ddb0b18c-33b9-4abc-b871-393a3e3cfa6f service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:35.066974 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-b0e87c1f-7fe4-4f6a-8947-60605d6eeaae req-ddb0b18c-33b9-4abc-b871-393a3e3cfa6f service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:35.083755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-b0e87c1f-7fe4-4f6a-8947-60605d6eeaae req-ddb0b18c-33b9-4abc-b871-393a3e3cfa6f service nova] Creating event network-changed:8d5caf68-fc5b-416c-8933-e257fcb6edd9 for instance 4aefc5a6-acfc-44c4-8693-49c65685d81a on hv-cinder-79987 Jul 19 21:05:35.090054 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-b0e87c1f-7fe4-4f6a-8947-60605d6eeaae req-ddb0b18c-33b9-4abc-b871-393a3e3cfa6f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051114 Jul 19 21:05:35.090830 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 535/1037] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:35.923485 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e7501cd0-d79b-4d84-a4b8-5578353cd585 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:35.924700 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e7501cd0-d79b-4d84-a4b8-5578353cd585 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:35.932423 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e7501cd0-d79b-4d84-a4b8-5578353cd585 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:35.932879 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e7501cd0-d79b-4d84-a4b8-5578353cd585 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:35.933693 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e7501cd0-d79b-4d84-a4b8-5578353cd585 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:35.934146 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e7501cd0-d79b-4d84-a4b8-5578353cd585 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:36.074871 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e7501cd0-d79b-4d84-a4b8-5578353cd585 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:36.082764 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e7501cd0-d79b-4d84-a4b8-5578353cd585 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.163375 Jul 19 21:05:36.083352 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 503/1038] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:35 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:37.104429 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-46e02e5f-b7ae-4ef0-9690-9e1ac075b2e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:37.105440 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-46e02e5f-b7ae-4ef0-9690-9e1ac075b2e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:37.112362 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-46e02e5f-b7ae-4ef0-9690-9e1ac075b2e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:37.112833 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-46e02e5f-b7ae-4ef0-9690-9e1ac075b2e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:37.113654 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-46e02e5f-b7ae-4ef0-9690-9e1ac075b2e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:37.114102 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-46e02e5f-b7ae-4ef0-9690-9e1ac075b2e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:37.279751 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-46e02e5f-b7ae-4ef0-9690-9e1ac075b2e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:37.286102 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-46e02e5f-b7ae-4ef0-9690-9e1ac075b2e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.189622 Jul 19 21:05:37.286685 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 536/1039] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:37 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:38.304998 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-78664586-2e87-4eae-846e-6ea62aa5b789 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:38.305681 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-78664586-2e87-4eae-846e-6ea62aa5b789 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:38.312939 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-78664586-2e87-4eae-846e-6ea62aa5b789 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:38.313413 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-78664586-2e87-4eae-846e-6ea62aa5b789 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:38.314205 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-78664586-2e87-4eae-846e-6ea62aa5b789 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:38.314651 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-78664586-2e87-4eae-846e-6ea62aa5b789 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:38.458048 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-78664586-2e87-4eae-846e-6ea62aa5b789 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:38.466094 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-78664586-2e87-4eae-846e-6ea62aa5b789 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.165065 Jul 19 21:05:38.466709 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 504/1040] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:38 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:39.483697 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-dce0155d-4a15-4f4a-a77d-266138073c77 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:39.484289 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-dce0155d-4a15-4f4a-a77d-266138073c77 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:39.491434 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dce0155d-4a15-4f4a-a77d-266138073c77 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:39.491884 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dce0155d-4a15-4f4a-a77d-266138073c77 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:39.492648 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dce0155d-4a15-4f4a-a77d-266138073c77 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:39.493080 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-dce0155d-4a15-4f4a-a77d-266138073c77 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:39.642877 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-dce0155d-4a15-4f4a-a77d-266138073c77 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:39.651052 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-dce0155d-4a15-4f4a-a77d-266138073c77 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.171217 Jul 19 21:05:39.654621 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 537/1041] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:39 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:40.669219 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-29909848-9a8b-4a4c-9c1e-35e360d33ba2 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:40.669850 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-29909848-9a8b-4a4c-9c1e-35e360d33ba2 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:40.677305 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-29909848-9a8b-4a4c-9c1e-35e360d33ba2 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:40.677788 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-29909848-9a8b-4a4c-9c1e-35e360d33ba2 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:40.678560 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-29909848-9a8b-4a4c-9c1e-35e360d33ba2 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:40.679005 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-29909848-9a8b-4a4c-9c1e-35e360d33ba2 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:40.818379 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-29909848-9a8b-4a4c-9c1e-35e360d33ba2 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:40.826482 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-29909848-9a8b-4a4c-9c1e-35e360d33ba2 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.161190 Jul 19 21:05:40.827097 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 505/1042] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:40 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:41.844879 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-553cd13f-038c-4e30-95cf-37d618bc067c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:41.847160 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-553cd13f-038c-4e30-95cf-37d618bc067c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:41.852534 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-553cd13f-038c-4e30-95cf-37d618bc067c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:41.852977 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-553cd13f-038c-4e30-95cf-37d618bc067c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:41.853851 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-553cd13f-038c-4e30-95cf-37d618bc067c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:41.854289 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-553cd13f-038c-4e30-95cf-37d618bc067c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:41.988164 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-553cd13f-038c-4e30-95cf-37d618bc067c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:41.999182 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-553cd13f-038c-4e30-95cf-37d618bc067c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.158667 Jul 19 21:05:42.000120 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 538/1043] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:41 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:43.018065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-d2d2de18-2b99-4db6-b987-b298033ef486 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:43.018780 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-d2d2de18-2b99-4db6-b987-b298033ef486 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:43.021908 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:43.027353 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2d2de18-2b99-4db6-b987-b298033ef486 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:43.027742 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2d2de18-2b99-4db6-b987-b298033ef486 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:43.028539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2d2de18-2b99-4db6-b987-b298033ef486 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:43.028974 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-d2d2de18-2b99-4db6-b987-b298033ef486 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:43.162753 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-d2d2de18-2b99-4db6-b987-b298033ef486 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:43.170411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-d2d2de18-2b99-4db6-b987-b298033ef486 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.156339 Jul 19 21:05:43.170976 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 506/1044] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:43 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:05:44.188069 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-66f87421-9f03-4fe9-999c-6e1c4c034900 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:44.188667 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-66f87421-9f03-4fe9-999c-6e1c4c034900 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:44.191184 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:44.191879 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=6 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:44.198267 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-66f87421-9f03-4fe9-999c-6e1c4c034900 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:44.198726 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-66f87421-9f03-4fe9-999c-6e1c4c034900 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:44.199493 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-66f87421-9f03-4fe9-999c-6e1c4c034900 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:44.199933 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-66f87421-9f03-4fe9-999c-6e1c4c034900 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:44.337483 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-66f87421-9f03-4fe9-999c-6e1c4c034900 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:44.345274 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-66f87421-9f03-4fe9-999c-6e1c4c034900 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.161179 Jul 19 21:05:44.345865 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 539/1045] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:44 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:05:45.362820 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-cf1f170f-5178-4854-90f7-76505b4626e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:45.363570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-cf1f170f-5178-4854-90f7-76505b4626e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:45.372543 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cf1f170f-5178-4854-90f7-76505b4626e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:45.373201 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cf1f170f-5178-4854-90f7-76505b4626e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:45.374195 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cf1f170f-5178-4854-90f7-76505b4626e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:45.374829 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cf1f170f-5178-4854-90f7-76505b4626e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:45.527376 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-cf1f170f-5178-4854-90f7-76505b4626e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:45.535684 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-cf1f170f-5178-4854-90f7-76505b4626e1 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.176786 Jul 19 21:05:45.536300 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 507/1046] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:45 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:46.552003 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b2bba6f1-31e1-4283-94b2-8ee0c1c42e7f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:46.552767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b2bba6f1-31e1-4283-94b2-8ee0c1c42e7f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:46.559367 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b2bba6f1-31e1-4283-94b2-8ee0c1c42e7f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:46.559821 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b2bba6f1-31e1-4283-94b2-8ee0c1c42e7f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:46.560598 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b2bba6f1-31e1-4283-94b2-8ee0c1c42e7f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:46.561037 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b2bba6f1-31e1-4283-94b2-8ee0c1c42e7f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:46.948995 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b2bba6f1-31e1-4283-94b2-8ee0c1c42e7f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:46.957340 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b2bba6f1-31e1-4283-94b2-8ee0c1c42e7f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.409643 Jul 19 21:05:46.957940 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 540/1047] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:46 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:47.454894 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-f727a9c3-cffe-49bd-90a4-3c4dae5c0f74 req-53b87ccb-992c-4bc8-8153-f9b5b4bb8c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aefc5a6-acfc-44c4-8693-49c65685d81a", "name": "network-vif-plugged", "status": "completed", "tag": "8d5caf68-fc5b-416c-8933-e257fcb6edd9"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:47.463775 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-f727a9c3-cffe-49bd-90a4-3c4dae5c0f74 req-53b87ccb-992c-4bc8-8153-f9b5b4bb8c3d service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:47.464224 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-f727a9c3-cffe-49bd-90a4-3c4dae5c0f74 req-53b87ccb-992c-4bc8-8153-f9b5b4bb8c3d service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:47.476612 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-f727a9c3-cffe-49bd-90a4-3c4dae5c0f74 req-53b87ccb-992c-4bc8-8153-f9b5b4bb8c3d service nova] Creating event network-vif-plugged:8d5caf68-fc5b-416c-8933-e257fcb6edd9 for instance 4aefc5a6-acfc-44c4-8693-49c65685d81a on hv-cinder-79987 Jul 19 21:05:47.481772 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-f727a9c3-cffe-49bd-90a4-3c4dae5c0f74 req-53b87ccb-992c-4bc8-8153-f9b5b4bb8c3d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030552 Jul 19 21:05:47.482557 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 508/1048] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:47.974081 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-bf37d250-c755-4ebe-ba6a-e3657adcd89c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:47.974997 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-bf37d250-c755-4ebe-ba6a-e3657adcd89c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:47.981923 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bf37d250-c755-4ebe-ba6a-e3657adcd89c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:47.982380 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bf37d250-c755-4ebe-ba6a-e3657adcd89c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:47.983157 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bf37d250-c755-4ebe-ba6a-e3657adcd89c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:47.983597 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bf37d250-c755-4ebe-ba6a-e3657adcd89c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:48.127842 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-bf37d250-c755-4ebe-ba6a-e3657adcd89c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:48.135915 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-bf37d250-c755-4ebe-ba6a-e3657adcd89c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.165691 Jul 19 21:05:48.136502 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 541/1049] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:47 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:49.154161 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-cdafedad-89f6-4aac-aa05-550f4709618b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:49.154864 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-cdafedad-89f6-4aac-aa05-550f4709618b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:49.161424 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cdafedad-89f6-4aac-aa05-550f4709618b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:49.162210 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cdafedad-89f6-4aac-aa05-550f4709618b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:49.163526 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cdafedad-89f6-4aac-aa05-550f4709618b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:49.164306 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-cdafedad-89f6-4aac-aa05-550f4709618b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:49.329326 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-cdafedad-89f6-4aac-aa05-550f4709618b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:49.338004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-cdafedad-89f6-4aac-aa05-550f4709618b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1257 microversion: 2.1 time: 0.188480 Jul 19 21:05:49.338725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 509/1050] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:49 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1257 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:50.356281 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-9fe338a7-f84c-4b97-9c85-04d2373bfed4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:50.356922 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-9fe338a7-f84c-4b97-9c85-04d2373bfed4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:50.364430 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fe338a7-f84c-4b97-9c85-04d2373bfed4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:50.364856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fe338a7-f84c-4b97-9c85-04d2373bfed4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:50.365662 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fe338a7-f84c-4b97-9c85-04d2373bfed4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:50.366093 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-9fe338a7-f84c-4b97-9c85-04d2373bfed4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:50.503016 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-9fe338a7-f84c-4b97-9c85-04d2373bfed4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:50.511050 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-9fe338a7-f84c-4b97-9c85-04d2373bfed4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1441 microversion: 2.1 time: 0.159383 Jul 19 21:05:50.511622 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 542/1051] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:50 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1441 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:50.528393 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-22f19218-699b-47b5-820b-557d4ce08330 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:50.529033 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-22f19218-699b-47b5-820b-557d4ce08330 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:50.535622 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-22f19218-699b-47b5-820b-557d4ce08330 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:50.536075 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-22f19218-699b-47b5-820b-557d4ce08330 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:50.536844 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-22f19218-699b-47b5-820b-557d4ce08330 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:50.537279 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-22f19218-699b-47b5-820b-557d4ce08330 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:50.671457 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-22f19218-699b-47b5-820b-557d4ce08330 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:50.679757 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-22f19218-699b-47b5-820b-557d4ce08330 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1441 microversion: 2.1 time: 0.155215 Jul 19 21:05:50.680430 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 510/1052] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:50 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1441 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:52.450296 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-ab4569c6-23b1-4eb1-a674-362d50ed0cd5 req-d3eff21e-c468-49c3-976a-6d2bbcba7264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aefc5a6-acfc-44c4-8693-49c65685d81a", "tag": "8d5caf68-fc5b-416c-8933-e257fcb6edd9"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:52.459029 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-ab4569c6-23b1-4eb1-a674-362d50ed0cd5 req-d3eff21e-c468-49c3-976a-6d2bbcba7264 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:52.459464 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-ab4569c6-23b1-4eb1-a674-362d50ed0cd5 req-d3eff21e-c468-49c3-976a-6d2bbcba7264 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:52.471934 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-ab4569c6-23b1-4eb1-a674-362d50ed0cd5 req-d3eff21e-c468-49c3-976a-6d2bbcba7264 service nova] Creating event network-changed:8d5caf68-fc5b-416c-8933-e257fcb6edd9 for instance 4aefc5a6-acfc-44c4-8693-49c65685d81a on hv-cinder-79987 Jul 19 21:05:52.480055 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-ab4569c6-23b1-4eb1-a674-362d50ed0cd5 req-d3eff21e-c468-49c3-976a-6d2bbcba7264 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093028 Jul 19 21:05:52.481972 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 543/1053] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:07:29.043874 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f74fdc9d-992c-4a75-9aa4-fcf9a6c8d041] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:07:29.044696 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=22 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:29.045473 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=50 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:29.052200 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-101756651", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-286713671", "security_groups": [{"name": "tempest-secgroup-smoke-1787866983"}], "block_device_mapping_v2": [{"uuid": "ed300a2f-2457-475c-9201-30fa507c37f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "231fd8b6-2aae-45bf-aa90-12b047385fb7"}]}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:29.169456 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.network.neutron [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] validate_networks() for [('231fd8b6-2aae-45bf-aa90-12b047385fb7', None, None, None, None, None)] {{(pid=129867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:07:29.538979 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Flavor limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:07:29.539407 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Image limits 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:07:29.539880 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Flavor pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:07:29.540290 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Image pref 0:0:0 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:07:29.540704 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.virt.hardware [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:07:29.550796 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:29.551245 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:29.552047 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:29.552486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:29.570387 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Getting quotas for project 60fdf04148f548f1b9fe86ed038e839f. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:07:29.574313 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.quota [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Getting quotas for user cf1d05ee73d4414eb51e2a7be838e28f and project 60fdf04148f548f1b9fe86ed038e839f. Resources: {'instances', 'ram', 'cores'} {{(pid=129867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:07:29.632999 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Going to run 1 instances... {{(pid=129867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:07:29.635121 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed300a2f-2457-475c-9201-30fa507c37f0',volume_size=None,volume_type=None)] {{(pid=129867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:07:29.764767 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-9d3e0602-39aa-48f4-bf78-9b89fb0ffda1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722662 Jul 19 21:07:29.765653 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 511/1054] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 19 21:07:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:07:29.773878 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:29.774852 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=54 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:29.779665 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-794bf370-1e7e-433b-a244-cb49332ddf96 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:29.780378 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-794bf370-1e7e-433b-a244-cb49332ddf96 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:29.837602 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-794bf370-1e7e-433b-a244-cb49332ddf96 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:29.844851 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-794bf370-1e7e-433b-a244-cb49332ddf96 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1093 microversion: 2.1 time: 0.072986 Jul 19 21:07:29.845439 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 544/1055] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:29 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:30.865050 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-cd6bda5e-6d18-447d-b8f4-f7e88145acdf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:30.866065 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-cd6bda5e-6d18-447d-b8f4-f7e88145acdf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:30.883637 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] [f74fdc9d-992c-4a75-9aa4-fcf9a6c8d041] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 55082. Jul 19 21:07:30.938862 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-cd6bda5e-6d18-447d-b8f4-f7e88145acdf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:30.945985 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-cd6bda5e-6d18-447d-b8f4-f7e88145acdf tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1093 microversion: 2.1 time: 0.087862 Jul 19 21:07:30.946885 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 512/1056] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:30 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1093 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:31.964822 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-94cb7882-3ce7-4498-9543-fafb98da89a6 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:31.965601 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-94cb7882-3ce7-4498-9543-fafb98da89a6 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:32.019751 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-94cb7882-3ce7-4498-9543-fafb98da89a6 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:32.027334 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-94cb7882-3ce7-4498-9543-fafb98da89a6 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1093 microversion: 2.1 time: 0.066037 Jul 19 21:07:32.027810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 545/1057] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:31 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:33.044228 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a52db126-2732-490c-895e-1fbe536e3339 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:33.045067 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a52db126-2732-490c-895e-1fbe536e3339 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:33.098806 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a52db126-2732-490c-895e-1fbe536e3339 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:33.106345 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a52db126-2732-490c-895e-1fbe536e3339 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1093 microversion: 2.1 time: 0.065968 Jul 19 21:07:33.106925 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 513/1058] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:33 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:34.123793 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2912b2b5-8ef6-4efb-916a-1ce645ecff66 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:34.124416 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2912b2b5-8ef6-4efb-916a-1ce645ecff66 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:34.132943 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2912b2b5-8ef6-4efb-916a-1ce645ecff66 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:34.133428 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2912b2b5-8ef6-4efb-916a-1ce645ecff66 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:34.134219 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2912b2b5-8ef6-4efb-916a-1ce645ecff66 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:34.134657 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2912b2b5-8ef6-4efb-916a-1ce645ecff66 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:34.196378 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2912b2b5-8ef6-4efb-916a-1ce645ecff66 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:34.206424 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2912b2b5-8ef6-4efb-916a-1ce645ecff66 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1143 microversion: 2.1 time: 0.086564 Jul 19 21:07:34.206981 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 546/1059] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:34 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:35.224370 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-23db03cb-ca55-4361-85b7-aecbf8bf918f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:35.225004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-23db03cb-ca55-4361-85b7-aecbf8bf918f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:35.232853 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-23db03cb-ca55-4361-85b7-aecbf8bf918f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:35.233314 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-23db03cb-ca55-4361-85b7-aecbf8bf918f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:35.234262 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-23db03cb-ca55-4361-85b7-aecbf8bf918f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:35.234891 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-23db03cb-ca55-4361-85b7-aecbf8bf918f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:35.303015 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-23db03cb-ca55-4361-85b7-aecbf8bf918f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:35.311521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-23db03cb-ca55-4361-85b7-aecbf8bf918f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1209 microversion: 2.1 time: 0.091165 Jul 19 21:07:35.319996 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 514/1060] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:35 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:36.331545 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-39ba0f58-dbbd-4ae7-96c6-da51fd301b17 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:36.332328 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-39ba0f58-dbbd-4ae7-96c6-da51fd301b17 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:36.339935 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-39ba0f58-dbbd-4ae7-96c6-da51fd301b17 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:36.340774 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-39ba0f58-dbbd-4ae7-96c6-da51fd301b17 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:36.341701 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-39ba0f58-dbbd-4ae7-96c6-da51fd301b17 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:36.342341 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-39ba0f58-dbbd-4ae7-96c6-da51fd301b17 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:36.506533 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-39ba0f58-dbbd-4ae7-96c6-da51fd301b17 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:36.517618 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-39ba0f58-dbbd-4ae7-96c6-da51fd301b17 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1265 microversion: 2.1 time: 0.191884 Jul 19 21:07:36.518324 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 547/1061] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:36 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:36.611248 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-4c5172e6-7198-4dc7-a5d9-be7c1c04156f req-3ed73e35-8e7e-4321-8e49-cb117d078a21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3a7a9d4-bf86-47af-bb4d-a9c3d6475494", "tag": "6273ea60-1049-4719-9378-bf23a419c8c2"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:36.620803 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-4c5172e6-7198-4dc7-a5d9-be7c1c04156f req-3ed73e35-8e7e-4321-8e49-cb117d078a21 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:36.621258 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-4c5172e6-7198-4dc7-a5d9-be7c1c04156f req-3ed73e35-8e7e-4321-8e49-cb117d078a21 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:36.635592 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-4c5172e6-7198-4dc7-a5d9-be7c1c04156f req-3ed73e35-8e7e-4321-8e49-cb117d078a21 service nova] Creating event network-changed:6273ea60-1049-4719-9378-bf23a419c8c2 for instance c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 on hv-cinder-79987 Jul 19 21:07:36.642031 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-4c5172e6-7198-4dc7-a5d9-be7c1c04156f req-3ed73e35-8e7e-4321-8e49-cb117d078a21 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123230 Jul 19 21:07:36.643067 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 515/1062] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:07:37.535539 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f5236dca-f43b-4323-8814-d2ae8681cc50 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:37.536180 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f5236dca-f43b-4323-8814-d2ae8681cc50 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:37.542911 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f5236dca-f43b-4323-8814-d2ae8681cc50 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:37.543445 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f5236dca-f43b-4323-8814-d2ae8681cc50 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:37.544216 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f5236dca-f43b-4323-8814-d2ae8681cc50 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:37.544656 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f5236dca-f43b-4323-8814-d2ae8681cc50 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:37.673773 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f5236dca-f43b-4323-8814-d2ae8681cc50 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:37.681226 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f5236dca-f43b-4323-8814-d2ae8681cc50 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1265 microversion: 2.1 time: 0.150061 Jul 19 21:07:37.681814 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 548/1063] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:37 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:38.265631 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:07:38.266137 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Tue Jul 19 21:07:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:07:38.698750 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4d7402ef-af48-464d-999c-897ddc056978 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:38.699608 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4d7402ef-af48-464d-999c-897ddc056978 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:38.707123 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4d7402ef-af48-464d-999c-897ddc056978 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:38.707585 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4d7402ef-af48-464d-999c-897ddc056978 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:38.708366 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4d7402ef-af48-464d-999c-897ddc056978 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:38.708811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4d7402ef-af48-464d-999c-897ddc056978 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:38.852726 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4d7402ef-af48-464d-999c-897ddc056978 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:38.861001 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4d7402ef-af48-464d-999c-897ddc056978 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1265 microversion: 2.1 time: 0.166000 Jul 19 21:07:38.861601 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 516/1064] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:38 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:39.879547 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d7a32ba1-3cc2-4f2b-bcc9-1b7f7dd86108 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:39.880276 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d7a32ba1-3cc2-4f2b-bcc9-1b7f7dd86108 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:39.886755 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d7a32ba1-3cc2-4f2b-bcc9-1b7f7dd86108 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:39.887201 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d7a32ba1-3cc2-4f2b-bcc9-1b7f7dd86108 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:39.887970 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d7a32ba1-3cc2-4f2b-bcc9-1b7f7dd86108 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:39.888417 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d7a32ba1-3cc2-4f2b-bcc9-1b7f7dd86108 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:40.021454 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d7a32ba1-3cc2-4f2b-bcc9-1b7f7dd86108 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:40.025787 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:07:40.026036 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Tue Jul 19 21:07:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 (ip 10.222.0.70) !!! Jul 19 21:07:40.030416 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d7a32ba1-3cc2-4f2b-bcc9-1b7f7dd86108 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1265 microversion: 2.1 time: 0.155800 Jul 19 21:07:40.031670 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 549/1065] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:39 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:07:41.048630 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-730833f6-7541-45df-bd82-be089e5ce401 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:41.049264 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-730833f6-7541-45df-bd82-be089e5ce401 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:41.051120 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=2 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:41.057047 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-730833f6-7541-45df-bd82-be089e5ce401 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:41.057541 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-730833f6-7541-45df-bd82-be089e5ce401 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:41.058299 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-730833f6-7541-45df-bd82-be089e5ce401 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:41.058734 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-730833f6-7541-45df-bd82-be089e5ce401 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:41.199396 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-730833f6-7541-45df-bd82-be089e5ce401 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:41.206895 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-730833f6-7541-45df-bd82-be089e5ce401 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1265 microversion: 2.1 time: 0.162799 Jul 19 21:07:41.207763 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 517/1066] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:41 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:42.224762 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d133909d-88a6-4b07-a5ed-5d94d4e44cf2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:42.225502 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d133909d-88a6-4b07-a5ed-5d94d4e44cf2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:42.227649 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell0:SELECT=4 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:42.233200 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d133909d-88a6-4b07-a5ed-5d94d4e44cf2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:42.233611 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d133909d-88a6-4b07-a5ed-5d94d4e44cf2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:42.234384 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d133909d-88a6-4b07-a5ed-5d94d4e44cf2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:42.234824 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d133909d-88a6-4b07-a5ed-5d94d4e44cf2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:42.366325 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d133909d-88a6-4b07-a5ed-5d94d4e44cf2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:42.374265 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d133909d-88a6-4b07-a5ed-5d94d4e44cf2 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1265 microversion: 2.1 time: 0.153137 Jul 19 21:07:42.374847 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 550/1067] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:42 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:43.391235 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b17de6c3-f23a-4144-ba0a-c682445fbaef tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:43.392419 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b17de6c3-f23a-4144-ba0a-c682445fbaef tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:43.394735 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell0:SELECT=10 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:43.400742 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b17de6c3-f23a-4144-ba0a-c682445fbaef tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:43.401200 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b17de6c3-f23a-4144-ba0a-c682445fbaef tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:43.402014 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b17de6c3-f23a-4144-ba0a-c682445fbaef tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:43.402454 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b17de6c3-f23a-4144-ba0a-c682445fbaef tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:43.534670 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-b17de6c3-f23a-4144-ba0a-c682445fbaef tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:43.542576 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b17de6c3-f23a-4144-ba0a-c682445fbaef tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1265 microversion: 2.1 time: 0.155176 Jul 19 21:07:43.543143 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 518/1068] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:43 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:44.560136 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-2e289042-b3ff-4e38-81a7-281ac6208cb1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:44.560767 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-2e289042-b3ff-4e38-81a7-281ac6208cb1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:44.567960 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2e289042-b3ff-4e38-81a7-281ac6208cb1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:44.568415 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2e289042-b3ff-4e38-81a7-281ac6208cb1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:44.569185 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2e289042-b3ff-4e38-81a7-281ac6208cb1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:44.569653 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-2e289042-b3ff-4e38-81a7-281ac6208cb1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:44.726321 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-2e289042-b3ff-4e38-81a7-281ac6208cb1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:44.734814 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-2e289042-b3ff-4e38-81a7-281ac6208cb1 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1265 microversion: 2.1 time: 0.178545 Jul 19 21:07:44.736446 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 551/1069] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:44 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:45.752939 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e3f382f6-9693-40c3-bdaa-3341e0b5c00b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:45.753570 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e3f382f6-9693-40c3-bdaa-3341e0b5c00b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:45.760348 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e3f382f6-9693-40c3-bdaa-3341e0b5c00b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:45.760800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e3f382f6-9693-40c3-bdaa-3341e0b5c00b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:45.761602 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e3f382f6-9693-40c3-bdaa-3341e0b5c00b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:45.762040 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e3f382f6-9693-40c3-bdaa-3341e0b5c00b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:45.902751 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e3f382f6-9693-40c3-bdaa-3341e0b5c00b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:45.911550 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e3f382f6-9693-40c3-bdaa-3341e0b5c00b tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1265 microversion: 2.1 time: 0.162411 Jul 19 21:07:45.912346 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 519/1070] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:45 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:46.928203 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0555218d-6a63-40c9-aebd-1bfb73091069 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:46.928836 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0555218d-6a63-40c9-aebd-1bfb73091069 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:46.935360 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0555218d-6a63-40c9-aebd-1bfb73091069 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:46.935810 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0555218d-6a63-40c9-aebd-1bfb73091069 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:46.936581 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0555218d-6a63-40c9-aebd-1bfb73091069 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:46.937022 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0555218d-6a63-40c9-aebd-1bfb73091069 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:47.076242 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0555218d-6a63-40c9-aebd-1bfb73091069 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:47.084932 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0555218d-6a63-40c9-aebd-1bfb73091069 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1265 microversion: 2.1 time: 0.160579 Jul 19 21:07:47.085543 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 552/1071] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:46 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:47.996170 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-816ac298-39f9-49ea-900a-9dc055137cca req-ff916874-9b86-4b26-9b14-395bcbcdd10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3a7a9d4-bf86-47af-bb4d-a9c3d6475494", "name": "network-vif-plugged", "status": "completed", "tag": "6273ea60-1049-4719-9378-bf23a419c8c2"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:48.004811 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-816ac298-39f9-49ea-900a-9dc055137cca req-ff916874-9b86-4b26-9b14-395bcbcdd10e service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:48.005267 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-816ac298-39f9-49ea-900a-9dc055137cca req-ff916874-9b86-4b26-9b14-395bcbcdd10e service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:48.017043 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-816ac298-39f9-49ea-900a-9dc055137cca req-ff916874-9b86-4b26-9b14-395bcbcdd10e service nova] Creating event network-vif-plugged:6273ea60-1049-4719-9378-bf23a419c8c2 for instance c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 on hv-cinder-79987 Jul 19 21:07:48.022367 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-816ac298-39f9-49ea-900a-9dc055137cca req-ff916874-9b86-4b26-9b14-395bcbcdd10e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095919 Jul 19 21:07:48.022968 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 520/1072] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:07:48.101852 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-25ddba53-e98f-4e5e-a202-4409ff6054e5 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:48.102467 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-25ddba53-e98f-4e5e-a202-4409ff6054e5 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:48.109220 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-25ddba53-e98f-4e5e-a202-4409ff6054e5 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:48.109690 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-25ddba53-e98f-4e5e-a202-4409ff6054e5 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:48.110498 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-25ddba53-e98f-4e5e-a202-4409ff6054e5 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:48.110929 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-25ddba53-e98f-4e5e-a202-4409ff6054e5 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:48.253906 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-25ddba53-e98f-4e5e-a202-4409ff6054e5 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:48.261515 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-25ddba53-e98f-4e5e-a202-4409ff6054e5 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1265 microversion: 2.1 time: 0.163610 Jul 19 21:07:48.262013 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 553/1073] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:48 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:49.279942 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-37e972ff-657b-4099-a9d2-536b690ac69c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:49.280762 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-37e972ff-657b-4099-a9d2-536b690ac69c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:49.287863 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-37e972ff-657b-4099-a9d2-536b690ac69c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:49.288349 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-37e972ff-657b-4099-a9d2-536b690ac69c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:49.289133 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-37e972ff-657b-4099-a9d2-536b690ac69c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:49.289608 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-37e972ff-657b-4099-a9d2-536b690ac69c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:49.431577 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-37e972ff-657b-4099-a9d2-536b690ac69c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:49.439125 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-37e972ff-657b-4099-a9d2-536b690ac69c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1265 microversion: 2.1 time: 0.163868 Jul 19 21:07:49.439973 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 521/1074] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:49 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:50.456985 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-077121b3-9721-4225-b181-34f50d7f58a7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:50.457716 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-077121b3-9721-4225-b181-34f50d7f58a7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:50.464266 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-077121b3-9721-4225-b181-34f50d7f58a7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:50.464718 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-077121b3-9721-4225-b181-34f50d7f58a7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:50.465507 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-077121b3-9721-4225-b181-34f50d7f58a7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:50.465949 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-077121b3-9721-4225-b181-34f50d7f58a7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:50.600324 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-077121b3-9721-4225-b181-34f50d7f58a7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:50.608725 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-077121b3-9721-4225-b181-34f50d7f58a7 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1451 microversion: 2.1 time: 0.156123 Jul 19 21:07:50.609285 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 554/1075] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:50 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:50.625172 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-953fc2e8-4162-4b6d-9876-6aa6d38eb4f4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:50.626154 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-953fc2e8-4162-4b6d-9876-6aa6d38eb4f4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:50.633288 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-953fc2e8-4162-4b6d-9876-6aa6d38eb4f4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:50.633857 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-953fc2e8-4162-4b6d-9876-6aa6d38eb4f4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:50.634800 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-953fc2e8-4162-4b6d-9876-6aa6d38eb4f4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:50.635240 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-953fc2e8-4162-4b6d-9876-6aa6d38eb4f4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:50.782033 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-953fc2e8-4162-4b6d-9876-6aa6d38eb4f4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:50.791840 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-953fc2e8-4162-4b6d-9876-6aa6d38eb4f4 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1451 microversion: 2.1 time: 0.170509 Jul 19 21:07:50.792580 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 522/1076] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:50 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:52.747655 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [req-e1a8f956-7720-4fe3-af06-c03f6e976022 req-6847b40b-877b-4b63-beda-01e1f8db2e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3a7a9d4-bf86-47af-bb4d-a9c3d6475494", "tag": "6273ea60-1049-4719-9378-bf23a419c8c2"}]} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:52.756700 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-e1a8f956-7720-4fe3-af06-c03f6e976022 req-6847b40b-877b-4b63-beda-01e1f8db2e61 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:52.757231 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [req-e1a8f956-7720-4fe3-af06-c03f6e976022 req-6847b40b-877b-4b63-beda-01e1f8db2e61 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:52.769148 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.compute.server_external_events [req-e1a8f956-7720-4fe3-af06-c03f6e976022 req-6847b40b-877b-4b63-beda-01e1f8db2e61 service nova] Creating event network-changed:6273ea60-1049-4719-9378-bf23a419c8c2 for instance c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 on hv-cinder-79987 Jul 19 21:07:52.774401 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [req-e1a8f956-7720-4fe3-af06-c03f6e976022 req-6847b40b-877b-4b63-beda-01e1f8db2e61 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030699 Jul 19 21:07:52.775112 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 555/1077] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:07:54.198542 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:07:54.199237 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Tue Jul 19 21:07:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:08:10.707305 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-72252cc2-e585-40d7-b99d-6b77cee8ff4b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:10.708004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-72252cc2-e585-40d7-b99d-6b77cee8ff4b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:10.710131 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:10.710796 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=48 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:10.717552 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-72252cc2-e585-40d7-b99d-6b77cee8ff4b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:10.718868 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-72252cc2-e585-40d7-b99d-6b77cee8ff4b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:10.720013 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-72252cc2-e585-40d7-b99d-6b77cee8ff4b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:10.720479 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-72252cc2-e585-40d7-b99d-6b77cee8ff4b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:10.745605 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.objects.instance [None req-72252cc2-e585-40d7-b99d-6b77cee8ff4b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lazy-loading 'flavor' on Instance uuid 4aefc5a6-acfc-44c4-8693-49c65685d81a {{(pid=129867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:08:10.824722 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-72252cc2-e585-40d7-b99d-6b77cee8ff4b tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "POST /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a/action" status: 202 len: 0 microversion: 2.1 time: 0.121923 Jul 19 21:08:10.825330 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 523/1078] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 21:08:10 2022] POST /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:08:10.836242 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-8dad4697-f2ee-48f9-8773-7f986cf8c65d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:10.836833 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-8dad4697-f2ee-48f9-8773-7f986cf8c65d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:10.839582 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=28 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:10.840234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=56 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:10.849986 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8dad4697-f2ee-48f9-8773-7f986cf8c65d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:10.850468 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8dad4697-f2ee-48f9-8773-7f986cf8c65d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:10.851237 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8dad4697-f2ee-48f9-8773-7f986cf8c65d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:10.851688 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-8dad4697-f2ee-48f9-8773-7f986cf8c65d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:10.989138 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-8dad4697-f2ee-48f9-8773-7f986cf8c65d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:10.997100 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-8dad4697-f2ee-48f9-8773-7f986cf8c65d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.165270 Jul 19 21:08:10.997710 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 556/1079] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:10 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:12.019175 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7395e232-ac5a-4b2b-b56d-1767f6969d09 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:12.020377 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7395e232-ac5a-4b2b-b56d-1767f6969d09 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:12.027017 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7395e232-ac5a-4b2b-b56d-1767f6969d09 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:12.027469 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7395e232-ac5a-4b2b-b56d-1767f6969d09 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:12.028249 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7395e232-ac5a-4b2b-b56d-1767f6969d09 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:12.028688 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7395e232-ac5a-4b2b-b56d-1767f6969d09 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:12.178102 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7395e232-ac5a-4b2b-b56d-1767f6969d09 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:12.185891 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7395e232-ac5a-4b2b-b56d-1767f6969d09 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.171473 Jul 19 21:08:12.186468 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 524/1080] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:12 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:13.203572 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-c73bdf3a-5e62-4565-b566-59817225a51a tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:13.204203 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-c73bdf3a-5e62-4565-b566-59817225a51a tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:13.210895 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c73bdf3a-5e62-4565-b566-59817225a51a tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:13.211352 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c73bdf3a-5e62-4565-b566-59817225a51a tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:13.212127 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c73bdf3a-5e62-4565-b566-59817225a51a tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:13.212569 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-c73bdf3a-5e62-4565-b566-59817225a51a tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:13.349627 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-c73bdf3a-5e62-4565-b566-59817225a51a tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:13.357314 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-c73bdf3a-5e62-4565-b566-59817225a51a tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.157751 Jul 19 21:08:13.357921 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 557/1081] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:13 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:14.375337 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-e47b92b6-5ea0-4848-b012-a218a04c4009 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:14.375928 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-e47b92b6-5ea0-4848-b012-a218a04c4009 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:14.383040 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e47b92b6-5ea0-4848-b012-a218a04c4009 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:14.383489 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e47b92b6-5ea0-4848-b012-a218a04c4009 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:14.384261 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e47b92b6-5ea0-4848-b012-a218a04c4009 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:14.384733 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-e47b92b6-5ea0-4848-b012-a218a04c4009 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:14.522901 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-e47b92b6-5ea0-4848-b012-a218a04c4009 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:14.530795 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-e47b92b6-5ea0-4848-b012-a218a04c4009 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.159346 Jul 19 21:08:14.531371 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 525/1082] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:14 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:15.549213 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-08e9a78b-1b5d-49ee-a410-aee7990749c4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:15.550042 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-08e9a78b-1b5d-49ee-a410-aee7990749c4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:15.556623 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-08e9a78b-1b5d-49ee-a410-aee7990749c4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:15.557073 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-08e9a78b-1b5d-49ee-a410-aee7990749c4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:15.557870 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-08e9a78b-1b5d-49ee-a410-aee7990749c4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:15.558308 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-08e9a78b-1b5d-49ee-a410-aee7990749c4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:15.695717 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-08e9a78b-1b5d-49ee-a410-aee7990749c4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:15.704043 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-08e9a78b-1b5d-49ee-a410-aee7990749c4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.158707 Jul 19 21:08:15.704660 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 558/1083] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:15 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:16.721784 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5d7c6c33-91c4-4545-9a2c-5fe53b47ddef tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:16.722355 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5d7c6c33-91c4-4545-9a2c-5fe53b47ddef tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:16.728779 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5d7c6c33-91c4-4545-9a2c-5fe53b47ddef tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:16.729233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5d7c6c33-91c4-4545-9a2c-5fe53b47ddef tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:16.730042 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5d7c6c33-91c4-4545-9a2c-5fe53b47ddef tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:16.730492 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5d7c6c33-91c4-4545-9a2c-5fe53b47ddef tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:16.870286 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5d7c6c33-91c4-4545-9a2c-5fe53b47ddef tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:16.878051 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5d7c6c33-91c4-4545-9a2c-5fe53b47ddef tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.160611 Jul 19 21:08:16.878646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 526/1084] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:16 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:17.895745 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-4ac0d08c-e09a-4d6d-bdce-cb8a1b571eff tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:17.896372 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-4ac0d08c-e09a-4d6d-bdce-cb8a1b571eff tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:17.903615 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4ac0d08c-e09a-4d6d-bdce-cb8a1b571eff tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:17.903971 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4ac0d08c-e09a-4d6d-bdce-cb8a1b571eff tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:17.904748 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4ac0d08c-e09a-4d6d-bdce-cb8a1b571eff tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:17.905184 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-4ac0d08c-e09a-4d6d-bdce-cb8a1b571eff tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:18.056475 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-4ac0d08c-e09a-4d6d-bdce-cb8a1b571eff tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:18.064260 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-4ac0d08c-e09a-4d6d-bdce-cb8a1b571eff tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.172934 Jul 19 21:08:18.064947 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 559/1085] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:17 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:19.082813 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-4126bf6b-be54-4e2b-bee4-71b2bc669b3e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:19.083418 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-4126bf6b-be54-4e2b-bee4-71b2bc669b3e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:19.090046 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4126bf6b-be54-4e2b-bee4-71b2bc669b3e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:19.090498 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4126bf6b-be54-4e2b-bee4-71b2bc669b3e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:19.091272 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4126bf6b-be54-4e2b-bee4-71b2bc669b3e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:19.091713 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-4126bf6b-be54-4e2b-bee4-71b2bc669b3e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:19.230298 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-4126bf6b-be54-4e2b-bee4-71b2bc669b3e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:19.238067 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-4126bf6b-be54-4e2b-bee4-71b2bc669b3e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.159748 Jul 19 21:08:19.238655 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 527/1086] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:19 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:20.254705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-cddb8fff-2e97-4762-ab6e-14edf796ceb9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:20.255255 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-cddb8fff-2e97-4762-ab6e-14edf796ceb9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:20.262090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cddb8fff-2e97-4762-ab6e-14edf796ceb9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:20.262539 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cddb8fff-2e97-4762-ab6e-14edf796ceb9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:20.263304 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cddb8fff-2e97-4762-ab6e-14edf796ceb9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:20.263741 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-cddb8fff-2e97-4762-ab6e-14edf796ceb9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:20.399049 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-cddb8fff-2e97-4762-ab6e-14edf796ceb9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:20.406681 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-cddb8fff-2e97-4762-ab6e-14edf796ceb9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.155906 Jul 19 21:08:20.407312 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 560/1087] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:20 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:21.424924 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-6710fe10-376d-4ef2-b009-17c298fcf03d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:21.425578 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-6710fe10-376d-4ef2-b009-17c298fcf03d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:21.432725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6710fe10-376d-4ef2-b009-17c298fcf03d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:21.433187 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6710fe10-376d-4ef2-b009-17c298fcf03d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:21.433998 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6710fe10-376d-4ef2-b009-17c298fcf03d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:21.434436 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6710fe10-376d-4ef2-b009-17c298fcf03d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:21.570312 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-6710fe10-376d-4ef2-b009-17c298fcf03d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:21.578253 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-6710fe10-376d-4ef2-b009-17c298fcf03d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.157281 Jul 19 21:08:21.578816 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 528/1088] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:21 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:22.596853 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-fd20b949-27e2-4e23-8372-f82b649eea50 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:22.597496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-fd20b949-27e2-4e23-8372-f82b649eea50 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:22.599965 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de471c53-b295-4ec0-9bbc-f828a87ef939] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:08:22.604616 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fd20b949-27e2-4e23-8372-f82b649eea50 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:22.605072 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fd20b949-27e2-4e23-8372-f82b649eea50 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:22.605872 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fd20b949-27e2-4e23-8372-f82b649eea50 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:22.606314 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-fd20b949-27e2-4e23-8372-f82b649eea50 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:22.740063 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-fd20b949-27e2-4e23-8372-f82b649eea50 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:22.747522 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-fd20b949-27e2-4e23-8372-f82b649eea50 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.154859 Jul 19 21:08:22.748079 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 561/1089] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:22 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:23.766118 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-5eed77db-292f-4d44-8773-9ac9341a7622 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:23.766680 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-5eed77db-292f-4d44-8773-9ac9341a7622 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:23.773664 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5eed77db-292f-4d44-8773-9ac9341a7622 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:23.774120 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5eed77db-292f-4d44-8773-9ac9341a7622 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:23.774899 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5eed77db-292f-4d44-8773-9ac9341a7622 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:23.775340 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-5eed77db-292f-4d44-8773-9ac9341a7622 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:23.914232 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-5eed77db-292f-4d44-8773-9ac9341a7622 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:23.921723 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-5eed77db-292f-4d44-8773-9ac9341a7622 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1566 microversion: 2.1 time: 0.159687 Jul 19 21:08:23.922298 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 529/1090] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:23 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:23.938265 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-96159eac-59f3-4e7b-91e6-3cc1113d3b02 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:23.938861 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-96159eac-59f3-4e7b-91e6-3cc1113d3b02 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:23.952004 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-96159eac-59f3-4e7b-91e6-3cc1113d3b02 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:23.952451 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-96159eac-59f3-4e7b-91e6-3cc1113d3b02 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:23.953232 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-96159eac-59f3-4e7b-91e6-3cc1113d3b02 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:23.953706 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-96159eac-59f3-4e7b-91e6-3cc1113d3b02 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:23.958700 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO oslo.messaging._drivers.impl_rabbit [-] [de471c53-b295-4ec0-9bbc-f828a87ef939] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 55194. Jul 19 21:08:24.093650 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-96159eac-59f3-4e7b-91e6-3cc1113d3b02 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "POST /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a/action" status: 202 len: 0 microversion: 2.1 time: 0.159168 Jul 19 21:08:24.094533 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 562/1091] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 21:08:23 2022] POST /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:08:24.102651 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-f1736b72-8db9-4ace-886c-edfebc8e564d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:24.103358 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-f1736b72-8db9-4ace-886c-edfebc8e564d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:24.109887 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1736b72-8db9-4ace-886c-edfebc8e564d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:24.110505 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1736b72-8db9-4ace-886c-edfebc8e564d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:24.111405 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1736b72-8db9-4ace-886c-edfebc8e564d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:24.111914 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-f1736b72-8db9-4ace-886c-edfebc8e564d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:24.253004 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-f1736b72-8db9-4ace-886c-edfebc8e564d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:24.261053 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-f1736b72-8db9-4ace-886c-edfebc8e564d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1514 microversion: 2.1 time: 0.162245 Jul 19 21:08:24.262008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 530/1092] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:24 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:25.278670 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-1f160ae6-eaa8-429e-9bcb-b0d996a326c9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:25.279358 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-1f160ae6-eaa8-429e-9bcb-b0d996a326c9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:25.286222 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1f160ae6-eaa8-429e-9bcb-b0d996a326c9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:25.286883 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1f160ae6-eaa8-429e-9bcb-b0d996a326c9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:25.287629 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1f160ae6-eaa8-429e-9bcb-b0d996a326c9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:25.288063 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-1f160ae6-eaa8-429e-9bcb-b0d996a326c9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:25.436257 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-1f160ae6-eaa8-429e-9bcb-b0d996a326c9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:25.445012 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-1f160ae6-eaa8-429e-9bcb-b0d996a326c9 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1516 microversion: 2.1 time: 0.170668 Jul 19 21:08:25.445623 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 563/1093] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:25 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:26.092184 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-35ed3e78-f76f-46f5-a5c9-05647adf9da7 req-dd3f41b6-7b74-48b5-874e-384af364809b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aefc5a6-acfc-44c4-8693-49c65685d81a", "name": "network-vif-unplugged", "status": "completed", "tag": "8d5caf68-fc5b-416c-8933-e257fcb6edd9"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:26.101681 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-35ed3e78-f76f-46f5-a5c9-05647adf9da7 req-dd3f41b6-7b74-48b5-874e-384af364809b service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:26.102411 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-35ed3e78-f76f-46f5-a5c9-05647adf9da7 req-dd3f41b6-7b74-48b5-874e-384af364809b service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:26.114280 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-35ed3e78-f76f-46f5-a5c9-05647adf9da7 req-dd3f41b6-7b74-48b5-874e-384af364809b service nova] Creating event network-vif-unplugged:8d5caf68-fc5b-416c-8933-e257fcb6edd9 for instance 4aefc5a6-acfc-44c4-8693-49c65685d81a on hv-cinder-79987 Jul 19 21:08:26.119267 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-35ed3e78-f76f-46f5-a5c9-05647adf9da7 req-dd3f41b6-7b74-48b5-874e-384af364809b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031838 Jul 19 21:08:26.120080 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 531/1094] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:08:26.462963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-89eb3fdf-d797-43e0-8e2d-fc1de797333c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:26.463569 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-89eb3fdf-d797-43e0-8e2d-fc1de797333c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:26.470414 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-89eb3fdf-d797-43e0-8e2d-fc1de797333c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:26.470872 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-89eb3fdf-d797-43e0-8e2d-fc1de797333c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:26.471641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-89eb3fdf-d797-43e0-8e2d-fc1de797333c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:26.472084 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-89eb3fdf-d797-43e0-8e2d-fc1de797333c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:26.605023 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-89eb3fdf-d797-43e0-8e2d-fc1de797333c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:26.612598 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-89eb3fdf-d797-43e0-8e2d-fc1de797333c tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1572 microversion: 2.1 time: 0.153607 Jul 19 21:08:26.613161 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 564/1095] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:26 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:27.632519 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-2d5ca413-9e12-4726-a887-b5fcba21c85f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:27.633112 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-2d5ca413-9e12-4726-a887-b5fcba21c85f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:27.640121 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d5ca413-9e12-4726-a887-b5fcba21c85f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:27.640602 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d5ca413-9e12-4726-a887-b5fcba21c85f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:27.641394 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d5ca413-9e12-4726-a887-b5fcba21c85f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:27.641827 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-2d5ca413-9e12-4726-a887-b5fcba21c85f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:27.784985 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-2d5ca413-9e12-4726-a887-b5fcba21c85f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:27.792624 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-2d5ca413-9e12-4726-a887-b5fcba21c85f tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1572 microversion: 2.1 time: 0.165404 Jul 19 21:08:27.793188 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 532/1096] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:27 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:28.809317 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-163efa54-68cc-4c0e-a227-952c29850245 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:28.810044 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-163efa54-68cc-4c0e-a227-952c29850245 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:28.816578 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-163efa54-68cc-4c0e-a227-952c29850245 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:28.817565 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-163efa54-68cc-4c0e-a227-952c29850245 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:28.818361 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-163efa54-68cc-4c0e-a227-952c29850245 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:28.818800 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-163efa54-68cc-4c0e-a227-952c29850245 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:28.950363 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-163efa54-68cc-4c0e-a227-952c29850245 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:28.958782 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-163efa54-68cc-4c0e-a227-952c29850245 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1572 microversion: 2.1 time: 0.153339 Jul 19 21:08:28.959350 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 565/1097] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:28 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:29.976728 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ca7f9d25-02b1-4398-b5b7-d0e1403ce173 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:29.977346 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ca7f9d25-02b1-4398-b5b7-d0e1403ce173 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:29.983998 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ca7f9d25-02b1-4398-b5b7-d0e1403ce173 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:29.984459 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ca7f9d25-02b1-4398-b5b7-d0e1403ce173 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:29.985222 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ca7f9d25-02b1-4398-b5b7-d0e1403ce173 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:29.985694 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ca7f9d25-02b1-4398-b5b7-d0e1403ce173 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:30.119465 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ca7f9d25-02b1-4398-b5b7-d0e1403ce173 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:30.127505 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ca7f9d25-02b1-4398-b5b7-d0e1403ce173 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1572 microversion: 2.1 time: 0.155283 Jul 19 21:08:30.128084 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 533/1098] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:29 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:31.144558 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b1193bfb-28b2-4a19-9b9d-eaac5c81e37d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:31.145808 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-b1193bfb-28b2-4a19-9b9d-eaac5c81e37d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:31.152426 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b1193bfb-28b2-4a19-9b9d-eaac5c81e37d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:31.152873 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b1193bfb-28b2-4a19-9b9d-eaac5c81e37d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:31.154846 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b1193bfb-28b2-4a19-9b9d-eaac5c81e37d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:31.155329 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-b1193bfb-28b2-4a19-9b9d-eaac5c81e37d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:31.292060 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-b1193bfb-28b2-4a19-9b9d-eaac5c81e37d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:31.299613 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b1193bfb-28b2-4a19-9b9d-eaac5c81e37d tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1572 microversion: 2.1 time: 0.158940 Jul 19 21:08:31.300175 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 566/1099] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:31 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:32.318271 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-ad9f08dc-dd22-44ce-8ca4-bad69bd44f10 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:32.318872 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-ad9f08dc-dd22-44ce-8ca4-bad69bd44f10 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:32.325226 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ad9f08dc-dd22-44ce-8ca4-bad69bd44f10 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:32.325714 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ad9f08dc-dd22-44ce-8ca4-bad69bd44f10 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:32.326483 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ad9f08dc-dd22-44ce-8ca4-bad69bd44f10 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:32.326928 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-ad9f08dc-dd22-44ce-8ca4-bad69bd44f10 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:32.456810 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-ad9f08dc-dd22-44ce-8ca4-bad69bd44f10 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:32.464414 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-ad9f08dc-dd22-44ce-8ca4-bad69bd44f10 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1572 microversion: 2.1 time: 0.150729 Jul 19 21:08:32.465334 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 534/1100] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:32 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:33.481960 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-bc800684-bfb2-4df5-9fa2-b623baebb8cb tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:33.482578 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-bc800684-bfb2-4df5-9fa2-b623baebb8cb tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:33.489541 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bc800684-bfb2-4df5-9fa2-b623baebb8cb tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:33.489999 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bc800684-bfb2-4df5-9fa2-b623baebb8cb tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:33.490795 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bc800684-bfb2-4df5-9fa2-b623baebb8cb tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:33.491216 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-bc800684-bfb2-4df5-9fa2-b623baebb8cb tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:33.634647 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-bc800684-bfb2-4df5-9fa2-b623baebb8cb tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:33.642517 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-bc800684-bfb2-4df5-9fa2-b623baebb8cb tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1572 microversion: 2.1 time: 0.164531 Jul 19 21:08:33.643093 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 567/1101] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:33 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1572 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:34.660182 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-0ba9ae4b-1a0e-4c54-a1cb-8fca49a8d47e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:34.661565 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-0ba9ae4b-1a0e-4c54-a1cb-8fca49a8d47e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:34.668408 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ba9ae4b-1a0e-4c54-a1cb-8fca49a8d47e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:34.668860 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ba9ae4b-1a0e-4c54-a1cb-8fca49a8d47e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:34.669667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ba9ae4b-1a0e-4c54-a1cb-8fca49a8d47e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:34.670375 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-0ba9ae4b-1a0e-4c54-a1cb-8fca49a8d47e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:34.810174 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-0ba9ae4b-1a0e-4c54-a1cb-8fca49a8d47e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:34.818032 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-0ba9ae4b-1a0e-4c54-a1cb-8fca49a8d47e tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1572 microversion: 2.1 time: 0.161696 Jul 19 21:08:34.818635 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 535/1102] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:34 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:35.835403 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-0a76b09d-ad46-409b-bb45-caf6f03acfc4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:35.836038 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-0a76b09d-ad46-409b-bb45-caf6f03acfc4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:35.846014 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0a76b09d-ad46-409b-bb45-caf6f03acfc4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:35.846461 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0a76b09d-ad46-409b-bb45-caf6f03acfc4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:35.847235 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0a76b09d-ad46-409b-bb45-caf6f03acfc4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:35.847686 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-0a76b09d-ad46-409b-bb45-caf6f03acfc4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:35.985806 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-0a76b09d-ad46-409b-bb45-caf6f03acfc4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:35.993813 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-0a76b09d-ad46-409b-bb45-caf6f03acfc4 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1559 microversion: 2.1 time: 0.162560 Jul 19 21:08:35.994388 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 568/1103] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:35 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:36.156795 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-b4b9421a-ec54-4c8f-8844-ec13ffe4ba79 req-c54d44a5-e6da-4c56-a808-5d855b483676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aefc5a6-acfc-44c4-8693-49c65685d81a", "name": "network-vif-plugged", "status": "completed", "tag": "8d5caf68-fc5b-416c-8933-e257fcb6edd9"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:36.166267 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-b4b9421a-ec54-4c8f-8844-ec13ffe4ba79 req-c54d44a5-e6da-4c56-a808-5d855b483676 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:36.166716 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-b4b9421a-ec54-4c8f-8844-ec13ffe4ba79 req-c54d44a5-e6da-4c56-a808-5d855b483676 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:36.178646 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-b4b9421a-ec54-4c8f-8844-ec13ffe4ba79 req-c54d44a5-e6da-4c56-a808-5d855b483676 service nova] Creating event network-vif-plugged:8d5caf68-fc5b-416c-8933-e257fcb6edd9 for instance 4aefc5a6-acfc-44c4-8693-49c65685d81a on hv-cinder-79987 Jul 19 21:08:36.183956 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-b4b9421a-ec54-4c8f-8844-ec13ffe4ba79 req-c54d44a5-e6da-4c56-a808-5d855b483676 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030943 Jul 19 21:08:36.184571 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 536/1104] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:09:56.453944 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=28 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:56.454725 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:56.454916 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-ae882a1d-1166-4924-b44b-3a925fb52d60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:56.456605 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ae882a1d-1166-4924-b44b-3a925fb52d60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:56.461088 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-73065556-ea9c-4026-a0b2-ea7a10d2ccb4 req-3acf2f27-bde9-4b31-b1ee-a96d39d26e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3a7a9d4-bf86-47af-bb4d-a9c3d6475494", "tag": "6273ea60-1049-4719-9378-bf23a419c8c2"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:09:56.462311 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=28 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:56.462997 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:56.464705 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ae882a1d-1166-4924-b44b-3a925fb52d60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:56.465982 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ae882a1d-1166-4924-b44b-3a925fb52d60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:56.466382 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ae882a1d-1166-4924-b44b-3a925fb52d60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:56.466841 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-ae882a1d-1166-4924-b44b-3a925fb52d60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:56.473410 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-73065556-ea9c-4026-a0b2-ea7a10d2ccb4 req-3acf2f27-bde9-4b31-b1ee-a96d39d26e84 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:56.473877 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-73065556-ea9c-4026-a0b2-ea7a10d2ccb4 req-3acf2f27-bde9-4b31-b1ee-a96d39d26e84 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:56.487040 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-73065556-ea9c-4026-a0b2-ea7a10d2ccb4 req-3acf2f27-bde9-4b31-b1ee-a96d39d26e84 service nova] Creating event network-changed:6273ea60-1049-4719-9378-bf23a419c8c2 for instance c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 on hv-cinder-79987 Jul 19 21:09:56.493025 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-73065556-ea9c-4026-a0b2-ea7a10d2ccb4 req-3acf2f27-bde9-4b31-b1ee-a96d39d26e84 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041011 Jul 19 21:09:56.493673 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 537/1105] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:09:56.501859 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-ae882a1d-1166-4924-b44b-3a925fb52d60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Going to try to terminate instance {{(pid=129866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:09:56.603234 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-ae882a1d-1166-4924-b44b-3a925fb52d60 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 204 len: 0 microversion: 2.1 time: 0.153194 Jul 19 21:09:56.607303 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 569/1106] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 21:09:56 2022] DELETE /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:09:56.614359 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-107b4eb3-14ed-4733-b278-e6cb57131373 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:56.615389 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-107b4eb3-14ed-4733-b278-e6cb57131373 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:56.628882 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-107b4eb3-14ed-4733-b278-e6cb57131373 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:56.630289 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-107b4eb3-14ed-4733-b278-e6cb57131373 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:56.631842 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-107b4eb3-14ed-4733-b278-e6cb57131373 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:56.632290 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-107b4eb3-14ed-4733-b278-e6cb57131373 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:56.871771 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-107b4eb3-14ed-4733-b278-e6cb57131373 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:56.880616 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-107b4eb3-14ed-4733-b278-e6cb57131373 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1574 microversion: 2.1 time: 0.271440 Jul 19 21:09:56.881061 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 538/1107] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:56 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1574 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:57.899237 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-f50325fe-71be-42a3-98f9-4d703d23ed6d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:57.899928 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-f50325fe-71be-42a3-98f9-4d703d23ed6d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:57.906871 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f50325fe-71be-42a3-98f9-4d703d23ed6d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:57.907319 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f50325fe-71be-42a3-98f9-4d703d23ed6d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:57.908095 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f50325fe-71be-42a3-98f9-4d703d23ed6d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:57.909178 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-f50325fe-71be-42a3-98f9-4d703d23ed6d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:58.124438 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-f50325fe-71be-42a3-98f9-4d703d23ed6d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:58.132518 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-f50325fe-71be-42a3-98f9-4d703d23ed6d tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1574 microversion: 2.1 time: 0.237619 Jul 19 21:09:58.133073 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 570/1108] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:57 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1574 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:58.871838 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-d1ec4f96-8a57-4431-9259-c2810837c57d req-6248e131-37b7-4e17-86f4-0470580c0f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3a7a9d4-bf86-47af-bb4d-a9c3d6475494", "name": "network-vif-deleted", "tag": "6273ea60-1049-4719-9378-bf23a419c8c2"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:09:58.881250 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-d1ec4f96-8a57-4431-9259-c2810837c57d req-6248e131-37b7-4e17-86f4-0470580c0f2b service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:58.881744 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-d1ec4f96-8a57-4431-9259-c2810837c57d req-6248e131-37b7-4e17-86f4-0470580c0f2b service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:58.893938 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-d1ec4f96-8a57-4431-9259-c2810837c57d req-6248e131-37b7-4e17-86f4-0470580c0f2b service nova] Creating event network-vif-deleted:6273ea60-1049-4719-9378-bf23a419c8c2 for instance c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 on hv-cinder-79987 Jul 19 21:09:58.901528 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-d1ec4f96-8a57-4431-9259-c2810837c57d req-6248e131-37b7-4e17-86f4-0470580c0f2b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033238 Jul 19 21:09:58.902423 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 539/1109] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:09:59.151194 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-72637322-40ac-47eb-8972-b1cfb3a77c3f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:59.152424 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-72637322-40ac-47eb-8972-b1cfb3a77c3f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:59.163900 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72637322-40ac-47eb-8972-b1cfb3a77c3f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:59.164664 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72637322-40ac-47eb-8972-b1cfb3a77c3f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:59.165216 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72637322-40ac-47eb-8972-b1cfb3a77c3f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:59.165728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-72637322-40ac-47eb-8972-b1cfb3a77c3f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:59.248034 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-72637322-40ac-47eb-8972-b1cfb3a77c3f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:59.256046 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-72637322-40ac-47eb-8972-b1cfb3a77c3f tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 200 len: 1224 microversion: 2.1 time: 0.109941 Jul 19 21:09:59.256762 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 571/1110] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:59 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:00.274257 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8817dc51-8052-4a53-9464-693b3726b111 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:00.274951 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-8817dc51-8052-4a53-9464-693b3726b111 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: c3a7a9d4-bf86-47af-bb4d-a9c3d6475494] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:00.281450 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8817dc51-8052-4a53-9464-693b3726b111 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:00.281910 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8817dc51-8052-4a53-9464-693b3726b111 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:00.282686 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8817dc51-8052-4a53-9464-693b3726b111 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:00.283131 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-8817dc51-8052-4a53-9464-693b3726b111 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:00.297369 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-8817dc51-8052-4a53-9464-693b3726b111 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] HTTP exception thrown: Instance c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 could not be found. Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8817dc51-8052-4a53-9464-693b3726b111 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Request method failure captured: Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 HTTP/1.1 Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xuXKbIBFWqtz7fCbV5mHqDmGGePmBN0XUQUazmE64oh_bYT4Ze51l78hFAhiYvgahDxRICRhzQcXoNKJKjVBbEZXmBRpgRDJKYmvLD4fXY99_2hWue_KvWPa6kbXHDZFhwhOjUsbXJr8IBQprlaYW5ukh9vVixgIuYaTMqjaQhaDPs Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 60fdf04148f548f1b9fe86ed038e839f Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-TestVolumeBootPattern-904408898 Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 21:10:00.299105 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 21:10:00.301516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_60fdf04148f548f1b9fe86ed038e839f", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 21:10:00.301516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-TestVolumeBootPattern-904408898 Jul 19 21:10:00.301516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 60fdf04148f548f1b9fe86ed038e839f Jul 19 21:10:00.301516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-TestVolumeBootPattern-904408898 Jul 19 21:10:00.301516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-TestVolumeBootPattern-904408898-project Jul 19 21:10:00.301516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 21:10:00.301516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 21:10:00.301516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: cf1d05ee73d4414eb51e2a7be838e28f Jul 19 21:10:00.301516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-TestVolumeBootPattern-904408898-project Jul 19 21:10:00.301516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 21:10:00.301516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 could not be found. Jul 19 21:10:00.301516 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': 'c3a7a9d4-bf86-47af-bb4d-a9c3d6475494'} Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 could not be found. Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:10:00.302486 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 could not be found. Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 could not be found. Jul 19 21:10:00.304233 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:00.305717 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-8817dc51-8052-4a53-9464-693b3726b111 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Returning 404 to user: Instance c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:10:00.305717 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-8817dc51-8052-4a53-9464-693b3726b111 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494" status: 404 len: 111 microversion: 2.1 time: 0.031715 Jul 19 21:10:00.305717 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 540/1111] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:00 2022] GET /compute/v2.1/servers/c3a7a9d4-bf86-47af-bb4d-a9c3d6475494 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:10:03.451606 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-7488ebde-e91e-480d-be86-5c038a49ae45 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:03.452203 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-7488ebde-e91e-480d-be86-5c038a49ae45 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:03.456276 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-8b88410c-9d41-47dc-81d4-432ca3b665f0 req-4e083dde-e05d-408a-a7c4-4bdcfa4f2a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d", "tag": "7bddc221-6831-47f2-8121-1697a92ecc3b"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:03.459754 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7488ebde-e91e-480d-be86-5c038a49ae45 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:03.460534 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7488ebde-e91e-480d-be86-5c038a49ae45 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:03.461404 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7488ebde-e91e-480d-be86-5c038a49ae45 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:03.462133 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-7488ebde-e91e-480d-be86-5c038a49ae45 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:03.466656 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-8b88410c-9d41-47dc-81d4-432ca3b665f0 req-4e083dde-e05d-408a-a7c4-4bdcfa4f2a35 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:03.467106 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-8b88410c-9d41-47dc-81d4-432ca3b665f0 req-4e083dde-e05d-408a-a7c4-4bdcfa4f2a35 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:03.483046 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-8b88410c-9d41-47dc-81d4-432ca3b665f0 req-4e083dde-e05d-408a-a7c4-4bdcfa4f2a35 service nova] Creating event network-changed:7bddc221-6831-47f2-8121-1697a92ecc3b for instance e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d on hv-cinder-79987 Jul 19 21:10:03.489918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-8b88410c-9d41-47dc-81d4-432ca3b665f0 req-4e083dde-e05d-408a-a7c4-4bdcfa4f2a35 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039764 Jul 19 21:10:03.490691 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 541/1112] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:10:03.495764 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-7488ebde-e91e-480d-be86-5c038a49ae45 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Going to try to terminate instance {{(pid=129866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:10:03.619970 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-7488ebde-e91e-480d-be86-5c038a49ae45 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 204 len: 0 microversion: 2.1 time: 0.171879 Jul 19 21:10:03.624226 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 572/1113] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 21:10:03 2022] DELETE /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:10:03.630531 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a1aaf537-2cd1-4dc2-b379-a983c75e2b56 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:03.631880 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a1aaf537-2cd1-4dc2-b379-a983c75e2b56 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:03.640422 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a1aaf537-2cd1-4dc2-b379-a983c75e2b56 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:03.641461 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a1aaf537-2cd1-4dc2-b379-a983c75e2b56 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:03.642539 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a1aaf537-2cd1-4dc2-b379-a983c75e2b56 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:03.643076 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a1aaf537-2cd1-4dc2-b379-a983c75e2b56 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:03.809075 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-a1aaf537-2cd1-4dc2-b379-a983c75e2b56 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:03.818127 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a1aaf537-2cd1-4dc2-b379-a983c75e2b56 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1578 microversion: 2.1 time: 0.192109 Jul 19 21:10:03.818717 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 542/1114] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:03 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1578 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:04.836774 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-366d203a-65e4-46a6-8992-b8192d055662 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:04.837565 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-366d203a-65e4-46a6-8992-b8192d055662 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:04.844496 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-366d203a-65e4-46a6-8992-b8192d055662 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:04.845203 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-366d203a-65e4-46a6-8992-b8192d055662 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:04.846030 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-366d203a-65e4-46a6-8992-b8192d055662 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:04.846473 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-366d203a-65e4-46a6-8992-b8192d055662 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:04.993504 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-366d203a-65e4-46a6-8992-b8192d055662 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:05.002022 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-366d203a-65e4-46a6-8992-b8192d055662 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1459 microversion: 2.1 time: 0.170008 Jul 19 21:10:05.002624 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 573/1115] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:04 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1459 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:05.505819 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-126cc630-e4dc-4aa0-bffd-687ffc7ed35c req-2c8a3bea-727a-40e2-9232-700271577caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d", "name": "network-vif-deleted", "tag": "7bddc221-6831-47f2-8121-1697a92ecc3b"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:05.515033 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-126cc630-e4dc-4aa0-bffd-687ffc7ed35c req-2c8a3bea-727a-40e2-9232-700271577caf service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:05.515474 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-126cc630-e4dc-4aa0-bffd-687ffc7ed35c req-2c8a3bea-727a-40e2-9232-700271577caf service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:05.527236 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-126cc630-e4dc-4aa0-bffd-687ffc7ed35c req-2c8a3bea-727a-40e2-9232-700271577caf service nova] Creating event network-vif-deleted:7bddc221-6831-47f2-8121-1697a92ecc3b for instance e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d on hv-cinder-79987 Jul 19 21:10:05.531955 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-126cc630-e4dc-4aa0-bffd-687ffc7ed35c req-2c8a3bea-727a-40e2-9232-700271577caf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030856 Jul 19 21:10:05.532545 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 543/1116] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:10:06.021126 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5f3d15aa-5710-4fbb-9651-a3a43da7a43a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:06.022237 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5f3d15aa-5710-4fbb-9651-a3a43da7a43a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:06.031779 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f3d15aa-5710-4fbb-9651-a3a43da7a43a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:06.032238 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f3d15aa-5710-4fbb-9651-a3a43da7a43a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:06.033045 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f3d15aa-5710-4fbb-9651-a3a43da7a43a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:06.033641 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f3d15aa-5710-4fbb-9651-a3a43da7a43a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:06.069653 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f3d15aa-5710-4fbb-9651-a3a43da7a43a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:06.070146 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5f3d15aa-5710-4fbb-9651-a3a43da7a43a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:06.070603 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.objects.instance [None req-5f3d15aa-5710-4fbb-9651-a3a43da7a43a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lazy-loading 'fault' on Instance uuid e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d {{(pid=129866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:10:06.120288 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5f3d15aa-5710-4fbb-9651-a3a43da7a43a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1d05ee73d4414eb51e2a7be838e28f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fdf04148f548f1b9fe86ed038e839f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:06.127777 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5f3d15aa-5710-4fbb-9651-a3a43da7a43a tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 200 len: 1184 microversion: 2.1 time: 0.111629 Jul 19 21:10:06.128348 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 574/1117] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:06 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 1184 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:07.146122 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b5aeb35f-145a-4389-b764-f2f4d4e3c6ba tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:07.146875 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-b5aeb35f-145a-4389-b764-f2f4d4e3c6ba tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:07.153293 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5aeb35f-145a-4389-b764-f2f4d4e3c6ba tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:07.153780 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5aeb35f-145a-4389-b764-f2f4d4e3c6ba tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:07.154558 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5aeb35f-145a-4389-b764-f2f4d4e3c6ba tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:07.155002 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-b5aeb35f-145a-4389-b764-f2f4d4e3c6ba tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:07.168327 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-b5aeb35f-145a-4389-b764-f2f4d4e3c6ba tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] HTTP exception thrown: Instance e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d could not be found. Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b5aeb35f-145a-4389-b764-f2f4d4e3c6ba tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Request method failure captured: Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d HTTP/1.1 Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xuXKbIBFWqtz7fCbV5mHqDmGGePmBN0XUQUazmE64oh_bYT4Ze51l78hFAhiYvgahDxRICRhzQcXoNKJKjVBbEZXmBRpgRDJKYmvLD4fXY99_2hWue_KvWPa6kbXHDZFhwhOjUsbXJr8IBQprlaYW5ukh9vVixgIuYaTMqjaQhaDPs Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 60fdf04148f548f1b9fe86ed038e839f Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-TestVolumeBootPattern-904408898 Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 21:10:07.170007 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 21:10:07.172464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_60fdf04148f548f1b9fe86ed038e839f", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 21:10:07.172464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-TestVolumeBootPattern-904408898 Jul 19 21:10:07.172464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 60fdf04148f548f1b9fe86ed038e839f Jul 19 21:10:07.172464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-TestVolumeBootPattern-904408898 Jul 19 21:10:07.172464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-TestVolumeBootPattern-904408898-project Jul 19 21:10:07.172464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 21:10:07.172464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 21:10:07.172464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: cf1d05ee73d4414eb51e2a7be838e28f Jul 19 21:10:07.172464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-TestVolumeBootPattern-904408898-project Jul 19 21:10:07.172464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 21:10:07.172464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d could not be found. Jul 19 21:10:07.172464 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': 'e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d'} Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d could not be found. Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:10:07.173856 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d could not be found. Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d could not be found. Jul 19 21:10:07.175918 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.178456 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-b5aeb35f-145a-4389-b764-f2f4d4e3c6ba tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Returning 404 to user: Instance e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:10:07.178456 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-b5aeb35f-145a-4389-b764-f2f4d4e3c6ba tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d" status: 404 len: 111 microversion: 2.1 time: 0.030327 Jul 19 21:10:07.178456 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 544/1118] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:07 2022] GET /compute/v2.1/servers/e0147c0e-9d03-4c36-b5e4-d3eb7ab8981d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:10:07.868930 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-218d8bd0-4bcb-432d-8d53-228b4b2e9f3c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:07.869487 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-218d8bd0-4bcb-432d-8d53-228b4b2e9f3c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:07.875984 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-218d8bd0-4bcb-432d-8d53-228b4b2e9f3c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:07.876434 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-218d8bd0-4bcb-432d-8d53-228b4b2e9f3c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:07.877193 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-218d8bd0-4bcb-432d-8d53-228b4b2e9f3c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:07.877665 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-218d8bd0-4bcb-432d-8d53-228b4b2e9f3c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:07.890802 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.wsgi [None req-218d8bd0-4bcb-432d-8d53-228b4b2e9f3c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] HTTP exception thrown: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-218d8bd0-4bcb-432d-8d53-228b4b2e9f3c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Request method failure captured: Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: request: DELETE /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff HTTP/1.1 Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept: application/json Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Accept-Encoding: identity Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Connection: close Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Length: 0 Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Content-Type: application/json Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Host: 10.222.0.70 Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Openstack-System-Scope: None Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: User-Agent: python-urllib3/1.26.9 Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Auth-Token: gAAAAABi1xuXKbIBFWqtz7fCbV5mHqDmGGePmBN0XUQUazmE64oh_bYT4Ze51l78hFAhiYvgahDxRICRhzQcXoNKJKjVBbEZXmBRpgRDJKYmvLD4fXY99_2hWue_KvWPa6kbXHDZFhwhOjUsbXJr8IBQprlaYW5ukh9vVixgIuYaTMqjaQhaDPs Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Id: None Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Domain-Name: None Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Identity-Status: Confirmed Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Is-Admin-Project: True Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Id: default Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Domain-Name: Default Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Id: 60fdf04148f548f1b9fe86ed038e839f Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Project-Name: tempest-TestVolumeBootPattern-904408898 Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Role: member,reader Jul 19 21:10:07.892449 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Roles: member,reader Jul 19 21:10:07.894294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_60fdf04148f548f1b9fe86ed038e839f", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 21:10:07.894294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant: tempest-TestVolumeBootPattern-904408898 Jul 19 21:10:07.894294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Id: 60fdf04148f548f1b9fe86ed038e839f Jul 19 21:10:07.894294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-Tenant-Name: tempest-TestVolumeBootPattern-904408898 Jul 19 21:10:07.894294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User: tempest-TestVolumeBootPattern-904408898-project Jul 19 21:10:07.894294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Id: default Jul 19 21:10:07.894294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Domain-Name: Default Jul 19 21:10:07.894294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Id: cf1d05ee73d4414eb51e2a7be838e28f Jul 19 21:10:07.894294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: X-User-Name: tempest-TestVolumeBootPattern-904408898-project Jul 19 21:10:07.894294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: method: > Jul 19 21:10:07.894294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: exception: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:10:07.894294 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: action_args: {'id': 'fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff'} Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:10:07.895772 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:10:07.897391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.899225 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-218d8bd0-4bcb-432d-8d53-228b4b2e9f3c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Returning 404 to user: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. {{(pid=129866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:10:07.899225 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-218d8bd0-4bcb-432d-8d53-228b4b2e9f3c tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 404 len: 111 microversion: 2.1 time: 0.028929 Jul 19 21:10:07.899225 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 575/1119] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 21:10:07 2022] DELETE /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:10:07.903081 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a3891981-cfc2-4bf1-8c43-a5cdcc3c35f0 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:07.903735 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-a3891981-cfc2-4bf1-8c43-a5cdcc3c35f0 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] [instance: fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:07.909901 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a3891981-cfc2-4bf1-8c43-a5cdcc3c35f0 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:07.910378 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a3891981-cfc2-4bf1-8c43-a5cdcc3c35f0 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:07.911693 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a3891981-cfc2-4bf1-8c43-a5cdcc3c35f0 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:07.912135 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-a3891981-cfc2-4bf1-8c43-a5cdcc3c35f0 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:07.927532 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-a3891981-cfc2-4bf1-8c43-a5cdcc3c35f0 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] HTTP exception thrown: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a3891981-cfc2-4bf1-8c43-a5cdcc3c35f0 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Request method failure captured: Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff HTTP/1.1 Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xuXKbIBFWqtz7fCbV5mHqDmGGePmBN0XUQUazmE64oh_bYT4Ze51l78hFAhiYvgahDxRICRhzQcXoNKJKjVBbEZXmBRpgRDJKYmvLD4fXY99_2hWue_KvWPa6kbXHDZFhwhOjUsbXJr8IBQprlaYW5ukh9vVixgIuYaTMqjaQhaDPs Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 60fdf04148f548f1b9fe86ed038e839f Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-TestVolumeBootPattern-904408898 Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 21:10:07.930589 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 21:10:07.932401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60fdf04148f548f1b9fe86ed038e839f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_60fdf04148f548f1b9fe86ed038e839f", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 21:10:07.932401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-TestVolumeBootPattern-904408898 Jul 19 21:10:07.932401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 60fdf04148f548f1b9fe86ed038e839f Jul 19 21:10:07.932401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-TestVolumeBootPattern-904408898 Jul 19 21:10:07.932401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-TestVolumeBootPattern-904408898-project Jul 19 21:10:07.932401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 21:10:07.932401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 21:10:07.932401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: cf1d05ee73d4414eb51e2a7be838e28f Jul 19 21:10:07.932401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-TestVolumeBootPattern-904408898-project Jul 19 21:10:07.932401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 21:10:07.932401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:10:07.932401 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': 'fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff'} Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:10:07.933521 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. Jul 19 21:10:07.935113 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:10:07.936593 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-a3891981-cfc2-4bf1-8c43-a5cdcc3c35f0 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Returning 404 to user: Instance fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:10:07.936593 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-a3891981-cfc2-4bf1-8c43-a5cdcc3c35f0 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff" status: 404 len: 111 microversion: 2.1 time: 0.032848 Jul 19 21:10:07.936593 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 545/1120] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:07 2022] GET /compute/v2.1/servers/fb8e27b1-b4f2-4fb7-a21f-6ad71ad3deff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:10:09.237669 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b016d4d3-7502-423c-aa51-00c94c161929 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] Calling method '.version_select at 0x7f25276a19d0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:09.261339 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b016d4d3-7502-423c-aa51-00c94c161929 tempest-TestVolumeBootPattern-904408898 tempest-TestVolumeBootPattern-904408898-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-286713671" status: 202 len: 0 microversion: 2.1 time: 0.027618 Jul 19 21:10:09.261949 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 576/1121] 10.222.0.70 () {58 vars in 1259 bytes} [Tue Jul 19 21:10:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-286713671 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:10:49.003010 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:10:49.003666 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Tue Jul 19 21:10:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:10:58.273983 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:10:58.274658 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Tue Jul 19 21:10:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:11:14.207856 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:11:14.208471 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Tue Jul 19 21:11:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:12:06.516667 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_api:SELECT=18 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:06.517497 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG dbcounter [-] [129867] Writing DB stats nova_cell1:SELECT=26 {{(pid=129867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:06.677442 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-6a5b0686-c38b-448e-92df-0eed2b018f55 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:06.678911 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-6a5b0686-c38b-448e-92df-0eed2b018f55 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:06.685849 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6a5b0686-c38b-448e-92df-0eed2b018f55 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:06.686304 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6a5b0686-c38b-448e-92df-0eed2b018f55 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:06.687076 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6a5b0686-c38b-448e-92df-0eed2b018f55 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:06.687517 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-6a5b0686-c38b-448e-92df-0eed2b018f55 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:06.767499 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-6a5b0686-c38b-448e-92df-0eed2b018f55 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "POST /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a/action" status: 200 len: 63081 microversion: 2.1 time: 0.255895 Jul 19 21:12:06.768153 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 546/1122] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 19 21:12:06 2022] POST /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a/action => generated 63081 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:12:07.635053 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de471c53-b295-4ec0-9bbc-f828a87ef939] AMQP server on 10.222.0.70:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 19 21:12:07.635728 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:07.636936 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG dbcounter [-] [129866] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:07.642840 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-3121b3f2-3c32-42ed-abdb-2dd1e47c1768 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:07.643342 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3121b3f2-3c32-42ed-abdb-2dd1e47c1768 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:07.653741 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3121b3f2-3c32-42ed-abdb-2dd1e47c1768 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:07.654186 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3121b3f2-3c32-42ed-abdb-2dd1e47c1768 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:07.654966 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3121b3f2-3c32-42ed-abdb-2dd1e47c1768 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:07.655401 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-3121b3f2-3c32-42ed-abdb-2dd1e47c1768 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:07.682168 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-3121b3f2-3c32-42ed-abdb-2dd1e47c1768 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Going to try to terminate instance {{(pid=129866) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:12:07.699173 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-473ff461-85bc-4db9-9b19-4040ffe4f24c req-d831891f-216b-4650-ae36-7758e415b584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aefc5a6-acfc-44c4-8693-49c65685d81a", "tag": "8d5caf68-fc5b-416c-8933-e257fcb6edd9"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:07.708575 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-473ff461-85bc-4db9-9b19-4040ffe4f24c req-d831891f-216b-4650-ae36-7758e415b584 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:07.709663 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-473ff461-85bc-4db9-9b19-4040ffe4f24c req-d831891f-216b-4650-ae36-7758e415b584 service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:07.720294 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-473ff461-85bc-4db9-9b19-4040ffe4f24c req-d831891f-216b-4650-ae36-7758e415b584 service nova] Creating event network-changed:8d5caf68-fc5b-416c-8933-e257fcb6edd9 for instance 4aefc5a6-acfc-44c4-8693-49c65685d81a on hv-cinder-79987 Jul 19 21:12:07.726076 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-473ff461-85bc-4db9-9b19-4040ffe4f24c req-d831891f-216b-4650-ae36-7758e415b584 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091228 Jul 19 21:12:07.726985 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 547/1123] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:12:07.775421 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-3121b3f2-3c32-42ed-abdb-2dd1e47c1768 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 204 len: 0 microversion: 2.1 time: 0.144331 Jul 19 21:12:07.776391 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 577/1124] 10.222.0.70 () {58 vars in 1238 bytes} [Tue Jul 19 21:12:07 2022] DELETE /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:12:07.785668 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-7f8224fb-a6a0-41fb-8257-a8d6bc5a3353 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:07.786404 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-7f8224fb-a6a0-41fb-8257-a8d6bc5a3353 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:07.793130 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7f8224fb-a6a0-41fb-8257-a8d6bc5a3353 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:07.793495 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7f8224fb-a6a0-41fb-8257-a8d6bc5a3353 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:07.794267 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7f8224fb-a6a0-41fb-8257-a8d6bc5a3353 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:07.794721 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-7f8224fb-a6a0-41fb-8257-a8d6bc5a3353 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:07.936344 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.policy [None req-7f8224fb-a6a0-41fb-8257-a8d6bc5a3353 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:07.944692 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-7f8224fb-a6a0-41fb-8257-a8d6bc5a3353 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.163754 Jul 19 21:12:07.945457 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 548/1125] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:07 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:12:08.962945 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-d0386fdd-40e2-41fd-86c8-4dc69caa7075 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:08.963847 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-d0386fdd-40e2-41fd-86c8-4dc69caa7075 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:08.977116 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO oslo.messaging._drivers.impl_rabbit [-] [de471c53-b295-4ec0-9bbc-f828a87ef939] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 55440. Jul 19 21:12:08.981504 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d0386fdd-40e2-41fd-86c8-4dc69caa7075 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:08.982090 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d0386fdd-40e2-41fd-86c8-4dc69caa7075 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:08.983302 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d0386fdd-40e2-41fd-86c8-4dc69caa7075 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:08.983749 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-d0386fdd-40e2-41fd-86c8-4dc69caa7075 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:09.137624 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-d0386fdd-40e2-41fd-86c8-4dc69caa7075 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:09.146358 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-d0386fdd-40e2-41fd-86c8-4dc69caa7075 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1565 microversion: 2.1 time: 0.187953 Jul 19 21:12:09.147111 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 578/1126] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:08 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:09.951410 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [req-9752e9af-b61e-4c44-9254-d316bf805d17 req-97255792-2f05-4c7b-9354-03a4fa14b84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aefc5a6-acfc-44c4-8693-49c65685d81a", "name": "network-vif-deleted", "tag": "8d5caf68-fc5b-416c-8933-e257fcb6edd9"}]} {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:09.961317 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-9752e9af-b61e-4c44-9254-d316bf805d17 req-97255792-2f05-4c7b-9354-03a4fa14b84e service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:09.961568 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [req-9752e9af-b61e-4c44-9254-d316bf805d17 req-97255792-2f05-4c7b-9354-03a4fa14b84e service nova] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:09.974325 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.compute.server_external_events [req-9752e9af-b61e-4c44-9254-d316bf805d17 req-97255792-2f05-4c7b-9354-03a4fa14b84e service nova] Creating event network-vif-deleted:8d5caf68-fc5b-416c-8933-e257fcb6edd9 for instance 4aefc5a6-acfc-44c4-8693-49c65685d81a on hv-cinder-79987 Jul 19 21:12:09.981822 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [req-9752e9af-b61e-4c44-9254-d316bf805d17 req-97255792-2f05-4c7b-9354-03a4fa14b84e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033964 Jul 19 21:12:09.985724 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 549/1127] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 19 21:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:12:10.162764 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-5d442752-0108-41f0-86dc-fa4f67dc2c92 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:10.163290 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.compute.api [None req-5d442752-0108-41f0-86dc-fa4f67dc2c92 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129866) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:10.169712 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5d442752-0108-41f0-86dc-fa4f67dc2c92 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:10.170155 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5d442752-0108-41f0-86dc-fa4f67dc2c92 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:10.170901 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5d442752-0108-41f0-86dc-fa4f67dc2c92 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:10.171331 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG oslo_concurrency.lockutils [None req-5d442752-0108-41f0-86dc-fa4f67dc2c92 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:10.234821 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.policy [None req-5d442752-0108-41f0-86dc-fa4f67dc2c92 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecfef5962b4242cda52c537e9440e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137218fb08e4f969b878d5cafd71eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129866) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:12:10.243457 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-5d442752-0108-41f0-86dc-fa4f67dc2c92 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 200 len: 1218 microversion: 2.1 time: 0.084589 Jul 19 21:12:10.243963 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 579/1128] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:10 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:12:11.261435 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-98c475be-4f05-4c62-9d6c-ae031d664fb6 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '>' {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:11.262169 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.compute.api [None req-98c475be-4f05-4c62-9d6c-ae031d664fb6 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] [instance: 4aefc5a6-acfc-44c4-8693-49c65685d81a] Fetching instance by UUID {{(pid=129867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:11.268680 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-98c475be-4f05-4c62-9d6c-ae031d664fb6 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:11.269141 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-98c475be-4f05-4c62-9d6c-ae031d664fb6 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:11.270907 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-98c475be-4f05-4c62-9d6c-ae031d664fb6 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:11.270907 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG oslo_concurrency.lockutils [None req-98c475be-4f05-4c62-9d6c-ae031d664fb6 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Lock "d9380775-e089-461a-bf53-b88b5dcfb5f1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:11.283822 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.wsgi [None req-98c475be-4f05-4c62-9d6c-ae031d664fb6 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] HTTP exception thrown: Instance 4aefc5a6-acfc-44c4-8693-49c65685d81a could not be found. Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-98c475be-4f05-4c62-9d6c-ae031d664fb6 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Request method failure captured: Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: request: GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a HTTP/1.1 Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept: application/json Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Accept-Encoding: identity Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Connection: close Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Length: 0 Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Content-Type: application/json Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Host: 10.222.0.70 Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Openstack-System-Scope: None Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: User-Agent: python-urllib3/1.26.9 Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Auth-Token: gAAAAABi1xx9HcXFOMIvGJteUZToOyvLCJwc_fvR7eZkidROZAr-dOhYoJQ9xc3f8zG8O4nh1eZ9H8szg6aLocPIgmwqhSHVaKWQ48HXZfwm-kohjR3RzTJf1iY7ZLbRhw-XFvJKd5Vm76Cw_RP8fFjeZF_VHXYiYheBxtXFXIUYN-9WUEduZes Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Id: None Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Domain-Name: None Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Identity-Status: Confirmed Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Is-Admin-Project: True Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Id: default Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Domain-Name: Default Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Id: 5137218fb08e4f969b878d5cafd71eb9 Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Project-Name: tempest-TestShelveInstance-459221285 Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Role: member,reader Jul 19 21:12:11.285508 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Roles: member,reader Jul 19 21:12:11.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5137218fb08e4f969b878d5cafd71eb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5137218fb08e4f969b878d5cafd71eb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5137218fb08e4f969b878d5cafd71eb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5137218fb08e4f969b878d5cafd71eb9", "adminURL": "http://10.222.0.70:8080"}]}] Jul 19 21:12:11.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant: tempest-TestShelveInstance-459221285 Jul 19 21:12:11.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Id: 5137218fb08e4f969b878d5cafd71eb9 Jul 19 21:12:11.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-Tenant-Name: tempest-TestShelveInstance-459221285 Jul 19 21:12:11.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User: tempest-TestShelveInstance-459221285-project Jul 19 21:12:11.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Id: default Jul 19 21:12:11.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Domain-Name: Default Jul 19 21:12:11.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Id: ecfef5962b4242cda52c537e9440e3f9 Jul 19 21:12:11.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: X-User-Name: tempest-TestShelveInstance-459221285-project Jul 19 21:12:11.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: method: > Jul 19 21:12:11.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: exception: Instance 4aefc5a6-acfc-44c4-8693-49c65685d81a could not be found. Jul 19 21:12:11.287992 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: action_args: {'id': '4aefc5a6-acfc-44c4-8693-49c65685d81a'} Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: {{(pid=129867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aefc5a6-acfc-44c4-8693-49c65685d81a could not be found. Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:12:11.289008 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aefc5a6-acfc-44c4-8693-49c65685d81a could not be found. Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aefc5a6-acfc-44c4-8693-49c65685d81a could not be found. Jul 19 21:12:11.290865 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: ERROR nova.api.openstack.wsgi Jul 19 21:12:11.292403 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: DEBUG nova.api.openstack.wsgi [None req-98c475be-4f05-4c62-9d6c-ae031d664fb6 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Returning 404 to user: Instance 4aefc5a6-acfc-44c4-8693-49c65685d81a could not be found. {{(pid=129867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:12:11.292403 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO nova.api.openstack.requestlog [None req-98c475be-4f05-4c62-9d6c-ae031d664fb6 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a" status: 404 len: 111 microversion: 2.1 time: 0.030327 Jul 19 21:12:11.292403 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: [pid: 129867|app: 0|req: 550/1129] 10.222.0.70 () {58 vars in 1235 bytes} [Tue Jul 19 21:12:11 2022] GET /compute/v2.1/servers/4aefc5a6-acfc-44c4-8693-49c65685d81a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:12:11.464704 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: DEBUG nova.api.openstack.wsgi [None req-b3584bff-27b6-4e6b-8fec-bbc613077752 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] Calling method '.version_select at 0x7f25276a19d0>' {{(pid=129866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:11.484405 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO nova.api.openstack.requestlog [None req-b3584bff-27b6-4e6b-8fec-bbc613077752 tempest-TestShelveInstance-459221285 tempest-TestShelveInstance-459221285-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-459913253" status: 202 len: 0 microversion: 2.1 time: 0.023551 Jul 19 21:12:11.484984 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: [pid: 129866|app: 0|req: 580/1130] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jul 19 21:12:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-459913253 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:14:09.013089 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:14:09.013735 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Tue Jul 19 21:14:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:14:18.282251 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:14:18.282831 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Tue Jul 19 21:14:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:14:28.564165 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:14:28.564800 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Tue Jul 19 21:14:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:14:34.216968 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:14:34.217712 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Tue Jul 19 21:14:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:14:48.077111 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:14:48.077692 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Tue Jul 19 21:14:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:17:29.022575 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:17:29.023387 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Tue Jul 19 21:17:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:17:38.290504 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:17:38.291258 dv-cinder-799871-37-iscsi devstack@n-api.service[129867]: Tue Jul 19 21:17:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:17:40.044854 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:17:40.045502 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Tue Jul 19 21:17:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:17:48.572516 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:17:48.573174 dv-cinder-799871-37-iscsi devstack@n-api.service[129866]: Tue Jul 19 21:17:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!